2026-03-28 05:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 05:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 05:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-28 05:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 05:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 05:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 05:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 05:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 05:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 23d9852a08cc7a99
2026-03-28 05:35:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 05:35:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-28T05_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 05:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:35:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:35:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 05:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 05:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 05:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-28 05:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 05:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 05:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 05:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 05:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 05:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 05:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 05:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 05:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 05:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 05:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 05:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 05:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 05:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 05:35:15 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:15 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-28 05:35:15 [auto1.de] INFO: Scrape type for UE63664: 2
2026-03-28 05:35:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-28 05:35:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c8618d-be7a-58b2-9488-aac1f029475d with scrape type 2
2026-03-28 05:35:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c8618d-be7a-58b2-9488-aac1f029475d with scrape type 2
2026-03-28 05:35:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c8618d-be7a-58b2-9488-aac1f029475d, identifier: UE63664
2026-03-28 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 05:35:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-28 05:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664 to the API
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:14Z',
 'fuel_type': 'diesel',
 'id': '77c8618d-be7a-58b2-9488-aac1f029475d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE63664',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 188246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Family FWD',
 'transmission': 'automatic',
 'trim': 'Family FWD',
 'year': 2021}
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Saving data for UE63664: {'auction_closing_time': 1774883294.0, 'created_time': 1774550733.05855, 'last_price_update_time': 1774676116.336662}
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE63664') HTTP/1.1" 204 0
2026-03-28 05:35:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 05:35:16 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB33854%27 HTTP/1.1" 200 None
2026-03-28 05:35:16 [auto1.de] INFO: Scrape type for WB33854: 2
2026-03-28 05:35:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d5a33a-bd23-593f-999f-66569ccf4452 with identifier: WB33854
2026-03-28 05:35:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d5a33a-bd23-593f-999f-66569ccf4452 with scrape type 2
2026-03-28 05:35:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d5a33a-bd23-593f-999f-66569ccf4452 with scrape type 2
2026-03-28 05:35:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d5a33a-bd23-593f-999f-66569ccf4452, identifier: WB33854
2026-03-28 05:35:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d5a33a-bd23-593f-999f-66569ccf4452 with identifier: WB33854
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 05:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 05:35:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d5a33a-bd23-593f-999f-66569ccf4452 with identifier: WB33854
2026-03-28 05:35:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d5a33a-bd23-593f-999f-66569ccf4452 with identifier: WB33854 to the API
2026-03-28 05:35:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:52:14Z',
 'fuel_type': 'electro',
 'id': 'c3d5a33a-bd23-593f-999f-66569ccf4452',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB33854',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.5',
 'odometer': 103934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Volkswagen ID.5 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2022}
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB33854%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Saving data for WB33854: {'auction_closing_time': 1774716734.0, 'created_time': 1774551982.515755, 'last_price_update_time': 1774676117.843729}
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB33854') HTTP/1.1" 204 0
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG17192%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for KG17192: 0
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: NP38259
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for GP13767: 1
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for VX83538: 1
2026-03-28 05:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for AM79611: 1
2026-03-28 05:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for ZY28796: 1
2026-03-28 05:35:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:17 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-28 05:35:17 [auto1.de] INFO: Scrape type for AD81240: 2
2026-03-28 05:35:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b73592d8-12ae-5551-945a-08fc5f9f2d00 with identifier: AD81240
2026-03-28 05:35:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b73592d8-12ae-5551-945a-08fc5f9f2d00 with scrape type 2
2026-03-28 05:35:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b73592d8-12ae-5551-945a-08fc5f9f2d00 with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b73592d8-12ae-5551-945a-08fc5f9f2d00, identifier: AD81240
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b73592d8-12ae-5551-945a-08fc5f9f2d00 with identifier: AD81240
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b73592d8-12ae-5551-945a-08fc5f9f2d00 with identifier: AD81240
2026-03-28 05:35:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b73592d8-12ae-5551-945a-08fc5f9f2d00 with identifier: AD81240 to the API
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:44:45Z',
 'fuel_type': 'diesel',
 'id': 'b73592d8-12ae-5551-945a-08fc5f9f2d00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD81240',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 214894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-30',
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2018}
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Saving data for AD81240: {'auction_closing_time': 1774716285.0, 'created_time': 1773400187.63531, 'last_price_update_time': 1774676118.505696}
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD81240') HTTP/1.1" 204 0
2026-03-28 05:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for RK52419: 1
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for XT54020: 1
2026-03-28 05:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for WE30814: 1
2026-03-28 05:35:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:18 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-28 05:35:18 [auto1.de] INFO: Scrape type for CV42130: 2
2026-03-28 05:35:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-28 05:35:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d83799-6f91-53a7-90a9-4bf5bf24e31e with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d83799-6f91-53a7-90a9-4bf5bf24e31e with scrape type 2
2026-03-28 05:35:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d83799-6f91-53a7-90a9-4bf5bf24e31e, identifier: CV42130
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 05:35:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-28 05:35:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130 to the API
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:57Z',
 'fuel_type': 'petrol',
 'id': '66d83799-6f91-53a7-90a9-4bf5bf24e31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV42130',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 123078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-27',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Saving data for CV42130: {'auction_closing_time': 1774714677.0, 'created_time': 1773229184.886588, 'last_price_update_time': 1774676119.891127}
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV42130') HTTP/1.1" 204 0
2026-03-28 05:35:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:19 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-28 05:35:19 [auto1.de] INFO: Scrape type for TV20692: 2
2026-03-28 05:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-28 05:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with scrape type 2
2026-03-28 05:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with scrape type 2
2026-03-28 05:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4, identifier: TV20692
2026-03-28 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-28 05:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-28 05:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692 to the API
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:16:10Z',
 'fuel_type': 'petrol',
 'id': 'f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV20692',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 83405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Saving data for TV20692: {'auction_closing_time': 1774714570.0, 'created_time': 1774034936.843896, 'last_price_update_time': 1774676120.368869}
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV20692') HTTP/1.1" 204 0
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for EA77246: 1
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for KL38868: 1
2026-03-28 05:35:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 05:35:20 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-28 05:35:20 [auto1.de] INFO: Scrape type for PU72162: 2
2026-03-28 05:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d51183-7708-56ec-a817-d42d2c04855f with identifier: PU72162
2026-03-28 05:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d51183-7708-56ec-a817-d42d2c04855f with scrape type 2
2026-03-28 05:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d51183-7708-56ec-a817-d42d2c04855f with scrape type 2
2026-03-28 05:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d51183-7708-56ec-a817-d42d2c04855f, identifier: PU72162
2026-03-28 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d51183-7708-56ec-a817-d42d2c04855f with identifier: PU72162
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 05:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d51183-7708-56ec-a817-d42d2c04855f with identifier: PU72162
2026-03-28 05:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d51183-7708-56ec-a817-d42d2c04855f with identifier: PU72162 to the API
2026-03-28 05:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:58:38Z',
 'fuel_type': 'petrol',
 'id': '66d51183-7708-56ec-a817-d42d2c04855f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU72162',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 66319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Saving data for PU72162: {'auction_closing_time': 1774717118.0, 'created_time': 1774349884.761632, 'last_price_update_time': 1774676121.844616}
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU72162') HTTP/1.1" 204 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for SD15904: 1
2026-03-28 05:35:21 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 05:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP13767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM79611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX83538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB33854%27 HTTP/1.1" 200 None
2026-03-28 05:35:21 [auto1.de] INFO: Scrape type for WB33854: 0
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 05:35:21 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG17192%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for KG17192: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: NP38259
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 05:35:22 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/GP13767/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-28 05:35:22 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 05:35:22 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 05:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK52419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE30814/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY28796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT54020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA77246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD15904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL38868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:23 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:23 [auto1.de] INFO: Found listing with ID: PC15308
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC15308%27 HTTP/1.1" 200 None
2026-03-28 05:35:23 [auto1.de] INFO: Scrape type for PC15308: 1
2026-03-28 05:35:23 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-28 05:35:23 [auto1.de] INFO: Scrape type for ME09470: 2
2026-03-28 05:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 149d58c6-0dac-5b04-951c-8b2306c42073 with identifier: ME09470
2026-03-28 05:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 149d58c6-0dac-5b04-951c-8b2306c42073 with scrape type 2
2026-03-28 05:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 149d58c6-0dac-5b04-951c-8b2306c42073 with scrape type 2
2026-03-28 05:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 149d58c6-0dac-5b04-951c-8b2306c42073, identifier: ME09470
2026-03-28 05:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 149d58c6-0dac-5b04-951c-8b2306c42073 with identifier: ME09470
2026-03-28 05:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 149d58c6-0dac-5b04-951c-8b2306c42073 with identifier: ME09470
2026-03-28 05:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 149d58c6-0dac-5b04-951c-8b2306c42073 with identifier: ME09470 to the API
2026-03-28 05:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:56:28Z',
 'fuel_type': 'petrol',
 'id': '149d58c6-0dac-5b04-951c-8b2306c42073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME09470',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 153549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Saving data for ME09470: {'auction_closing_time': 1774716988.0, 'created_time': 1774002321.41123, 'last_price_update_time': 1774676124.344664}
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME09470') HTTP/1.1" 204 0
2026-03-28 05:35:24 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-28 05:35:24 [auto1.de] INFO: Scrape type for HJ09616: 2
2026-03-28 05:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-28 05:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9685417a-9707-58cd-a6c6-3e81d32fec5b with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9685417a-9707-58cd-a6c6-3e81d32fec5b with scrape type 2
2026-03-28 05:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9685417a-9707-58cd-a6c6-3e81d32fec5b, identifier: HJ09616
2026-03-28 05:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-28 05:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-28 05:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616 to the API
2026-03-28 05:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:25:50Z',
 'fuel_type': 'diesel',
 'id': '9685417a-9707-58cd-a6c6-3e81d32fec5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ09616',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 34366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-28 05:35:25 [auto1.de] INFO: Saving data for HJ09616: {'auction_closing_time': 1774715150.0, 'created_time': 1772542335.742356, 'last_price_update_time': 1774676125.820977}
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ09616') HTTP/1.1" 204 0
2026-03-28 05:35:25 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-28 05:35:25 [auto1.de] INFO: Scrape type for CP73203: 2
2026-03-28 05:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-28 05:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c82589-57b1-500a-a6db-4838ecb884cc with scrape type 2
2026-03-28 05:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c82589-57b1-500a-a6db-4838ecb884cc with scrape type 2
2026-03-28 05:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0c82589-57b1-500a-a6db-4838ecb884cc, identifier: CP73203
2026-03-28 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP13767> (referer: https://www.auto1.com/v1/car-details-view/GP13767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM79611> (referer: https://www.auto1.com/v1/car-details-view/AM79611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE30814> (referer: https://www.auto1.com/v1/car-details-view/WE30814/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX83538> (referer: https://www.auto1.com/v1/car-details-view/VX83538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK52419> (referer: https://www.auto1.com/v1/car-details-view/RK52419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-28 05:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-28 05:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203 to the API
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:22Z',
 'fuel_type': 'petrol',
 'id': 'a0c82589-57b1-500a-a6db-4838ecb884cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP73203',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 112809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Saving data for CP73203: {'auction_closing_time': 1774714822.0, 'created_time': 1773831703.081645, 'last_price_update_time': 1774676126.393273}
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP73203') HTTP/1.1" 204 0
2026-03-28 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS28207%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for MS28207: 0
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for ND29954: 1
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: NV14001
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: GP45191
2026-03-28 05:35:26 [auto1.de] INFO: Found listing with ID: CB43306
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB43306%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [auto1.de] INFO: Scrape type for CB43306: 1
2026-03-28 05:35:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-28 05:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46b005e-5b79-5f79-939e-19efe26fe8cc with scrape type 1
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a46b005e-5b79-5f79-939e-19efe26fe8cc
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_f5e5d6be07123410159368e97e1996b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f5e5d6be07123410159368e97e1996b1.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_63cb622e1ba9e00adf590b97d6712136.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_63cb622e1ba9e00adf590b97d6712136.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_66b1f3ca682b61505d9eddf51842b07f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_66b1f3ca682b61505d9eddf51842b07f.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_a84fdaad720716f4fd271fed57925bf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_a84fdaad720716f4fd271fed57925bf5.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_ae8deaade734aedd6ab68cbc73383145.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_ae8deaade734aedd6ab68cbc73383145.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_9a3a751d52bb0a5488f721f4373d7cf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_9a3a751d52bb0a5488f721f4373d7cf3.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_1999ca80c7e32d5c242f2d7410f655d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_1999ca80c7e32d5c242f2d7410f655d1.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_d1fba0faec16ef0e3f7ad2ca9d0b77d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_d1fba0faec16ef0e3f7ad2ca9d0b77d7.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_243249a2f44b114db7ca7ca211d5cc2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_243249a2f44b114db7ca7ca211d5cc2c.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fa9%252F50a983761ec6b57400519b6115258f76%252Fpa%252FGP13767_f38547acc756e32e6d5157e5459459a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f38547acc756e32e6d5157e5459459a3.jpg already downloaded
2026-03-28 05:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46b005e-5b79-5f79-939e-19efe26fe8cc, identifier: GP13767
2026-03-28 05:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-28 05:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with scrape type 1
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c93512a-9e8b-5be3-8763-2eb2d1956f7f
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_3677c36a3d6d95f79e6516ebe84c714c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_3677c36a3d6d95f79e6516ebe84c714c.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_457c2ff3dab87a92cd187c6289acac30.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_457c2ff3dab87a92cd187c6289acac30.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_cf70177dd64277d86087330bdd37479e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_cf70177dd64277d86087330bdd37479e.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_04e7f3aa26d2cabd51cb3635318db489.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_04e7f3aa26d2cabd51cb3635318db489.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_f9b58700b9b3908e702363bd9825298c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_f9b58700b9b3908e702363bd9825298c.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_58908f1f8ee614ccdbb73c738de27294.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_58908f1f8ee614ccdbb73c738de27294.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_fe48f258da512e10e08506dc918b11f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_fe48f258da512e10e08506dc918b11f8.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_636a00e8049e140c39d1352aac3e8ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_636a00e8049e140c39d1352aac3e8ba9.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_61259f918d2d2cff2c2115f6666f7b9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_61259f918d2d2cff2c2115f6666f7b9e.jpg already downloaded
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Ffe%252Fd3fede33cce06b182b64cef92c87542c%252Fpa%252FAM79611_96986b35eab56989f64ff8caa1965147.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_96986b35eab56989f64ff8caa1965147.jpg already downloaded
2026-03-28 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f, identifier: AM79611
2026-03-28 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-28 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with scrape type 1
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_2c094e03d69760c7b619348009bad050.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_2c094e03d69760c7b619348009bad050.jpg not downloaded yet
2026-03-28 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-28 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830605b-8649-5321-818e-f1ecb6f47a11 with scrape type 1
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e830605b-8649-5321-818e-f1ecb6f47a11
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_8b0903b8ed2464735e8b8af0371f04e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8b0903b8ed2464735e8b8af0371f04e1.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_341f4f8a0e766c3afed0edba0a6e7897.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_341f4f8a0e766c3afed0edba0a6e7897.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_8c97452095a0824d9584162a7eb2f8c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8c97452095a0824d9584162a7eb2f8c9.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_b44fa38b1d4e253d4409ba38b66778f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_b44fa38b1d4e253d4409ba38b66778f9.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_1585b70bed4e22ed2ca5b63b16cfebaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_1585b70bed4e22ed2ca5b63b16cfebaf.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_597ef09a50801cdbe3ce68b2a9052d92.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_597ef09a50801cdbe3ce68b2a9052d92.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_17f17ff26de3333f05e32a36b76ec475.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_17f17ff26de3333f05e32a36b76ec475.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_bd6e79018657ee593329a85731c9757c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_bd6e79018657ee593329a85731c9757c.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_9b424fdcf40d1339e9b6169644224b74.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_9b424fdcf40d1339e9b6169644224b74.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F00%252F5200bb45bb3270a53bccc49d1db314ec%252Fpa%252FVX83538_30a207e3e8458388f3d69573e2337341.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_30a207e3e8458388f3d69573e2337341.jpg already downloaded
2026-03-28 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e830605b-8649-5321-818e-f1ecb6f47a11, identifier: VX83538
2026-03-28 05:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-28 05:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9408314-0b28-5ea1-924e-ff1403f012eb with scrape type 1
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9408314-0b28-5ea1-924e-ff1403f012eb
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_3a4efa15b8a8ff11be99867ea11a0e7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3a4efa15b8a8ff11be99867ea11a0e7f.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_3352add63744f4332e3854e5b9221d1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3352add63744f4332e3854e5b9221d1c.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_af4e56a04e25a09aa9affc7a0a365e73.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_af4e56a04e25a09aa9affc7a0a365e73.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_6552e3a14e1788e0e854f42b714cb87f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_6552e3a14e1788e0e854f42b714cb87f.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_872e6369617cbdfd03fd007665f283a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_872e6369617cbdfd03fd007665f283a3.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_c39434f1f89de670b7e7f3c61a921097.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_c39434f1f89de670b7e7f3c61a921097.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_1d01c544132b7d9f6b498bdc394a4f4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_1d01c544132b7d9f6b498bdc394a4f4f.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_8cc99711f2e5f172bbbf2a34b5488907.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_8cc99711f2e5f172bbbf2a34b5488907.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_aed51d300d2b1f1862a7683e4b7b10d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_aed51d300d2b1f1862a7683e4b7b10d2.jpg already downloaded
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fb8%252F92b8fa29152d47afe2e60ea0659873e3%252Fpa%252FRK52419_ee220aa13b115fb93246aacd8633943a.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_ee220aa13b115fb93246aacd8633943a.jpg already downloaded
2026-03-28 05:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9408314-0b28-5ea1-924e-ff1403f012eb, identifier: RK52419
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: UF03548
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for ZU14307: 0
2026-03-28 05:35:27 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-28 05:35:27 [auto1.de] INFO: Scrape type for TN04984: 1
2026-03-28 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 05:35:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-28 05:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767 to the API
2026-03-28 05:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP13767>
{'auction_title': '',
 'c_o_2_emission_value': 33,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:20:17Z',
 'fuel_type': 'hybrid',
 'id': 'a46b005e-5b79-5f79-939e-19efe26fe8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP13767',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 3650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f5e5d6be07123410159368e97e1996b1.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_63cb622e1ba9e00adf590b97d6712136.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_66b1f3ca682b61505d9eddf51842b07f.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_a84fdaad720716f4fd271fed57925bf5.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_ae8deaade734aedd6ab68cbc73383145.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_9a3a751d52bb0a5488f721f4373d7cf3.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_1999ca80c7e32d5c242f2d7410f655d1.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_d1fba0faec16ef0e3f7ad2ca9d0b77d7.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_243249a2f44b114db7ca7ca211d5cc2c.jpg',
                'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f38547acc756e32e6d5157e5459459a3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f5e5d6be07123410159368e97e1996b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_63cb622e1ba9e00adf590b97d6712136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_66b1f3ca682b61505d9eddf51842b07f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_a84fdaad720716f4fd271fed57925bf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_ae8deaade734aedd6ab68cbc73383145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_9a3a751d52bb0a5488f721f4373d7cf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_1999ca80c7e32d5c242f2d7410f655d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_d1fba0faec16ef0e3f7ad2ca9d0b77d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_243249a2f44b114db7ca7ca211d5cc2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a46b005e-5b79-5f79-939e-19efe26fe8cc/a46b005e-5b79-5f79-939e-19efe26fe8cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/a9/50a983761ec6b57400519b6115258f76/pa/GP13767_f38547acc756e32e6d5157e5459459a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Saving data for GP13767: {'created_time': 1774676128.247243, 'last_price_update_time': 1774676128.247253, 'auction_closing_time': 1774714817.0}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP13767') HTTP/1.1" 204 0
2026-03-28 05:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-28 05:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-28 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611 to the API
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AM79611>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:05Z',
 'fuel_type': 'petrol',
 'id': '4c93512a-9e8b-5be3-8763-2eb2d1956f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM79611',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 104840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_3677c36a3d6d95f79e6516ebe84c714c.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_457c2ff3dab87a92cd187c6289acac30.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_cf70177dd64277d86087330bdd37479e.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_04e7f3aa26d2cabd51cb3635318db489.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_f9b58700b9b3908e702363bd9825298c.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_58908f1f8ee614ccdbb73c738de27294.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_fe48f258da512e10e08506dc918b11f8.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_636a00e8049e140c39d1352aac3e8ba9.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_61259f918d2d2cff2c2115f6666f7b9e.jpg',
                'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_96986b35eab56989f64ff8caa1965147.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_3677c36a3d6d95f79e6516ebe84c714c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2350751,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_457c2ff3dab87a92cd187c6289acac30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2267337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_cf70177dd64277d86087330bdd37479e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2174526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_04e7f3aa26d2cabd51cb3635318db489.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2180102,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_f9b58700b9b3908e702363bd9825298c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_58908f1f8ee614ccdbb73c738de27294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2155535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_fe48f258da512e10e08506dc918b11f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2156032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_636a00e8049e140c39d1352aac3e8ba9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_61259f918d2d2cff2c2115f6666f7b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c93512a-9e8b-5be3-8763-2eb2d1956f7f/4c93512a-9e8b-5be3-8763-2eb2d1956f7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2377079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/fe/d3fede33cce06b182b64cef92c87542c/pa/AM79611_96986b35eab56989f64ff8caa1965147.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-28 05:35:28 [auto1.de] INFO: Saving data for AM79611: {'created_time': 1774676128.690153, 'last_price_update_time': 1774676128.690163, 'auction_closing_time': 1774714385.0}
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM79611') HTTP/1.1" 204 0
2026-03-28 05:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-28 05:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-28 05:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538 to the API
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX83538>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:16:41Z',
 'fuel_type': 'diesel',
 'id': 'e830605b-8649-5321-818e-f1ecb6f47a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX83538',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 136738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8b0903b8ed2464735e8b8af0371f04e1.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_341f4f8a0e766c3afed0edba0a6e7897.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8c97452095a0824d9584162a7eb2f8c9.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_b44fa38b1d4e253d4409ba38b66778f9.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_1585b70bed4e22ed2ca5b63b16cfebaf.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_597ef09a50801cdbe3ce68b2a9052d92.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_17f17ff26de3333f05e32a36b76ec475.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_bd6e79018657ee593329a85731c9757c.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_9b424fdcf40d1339e9b6169644224b74.jpg',
                'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_30a207e3e8458388f3d69573e2337341.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67574,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8b0903b8ed2464735e8b8af0371f04e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_341f4f8a0e766c3afed0edba0a6e7897.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_8c97452095a0824d9584162a7eb2f8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_b44fa38b1d4e253d4409ba38b66778f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_1585b70bed4e22ed2ca5b63b16cfebaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_597ef09a50801cdbe3ce68b2a9052d92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_17f17ff26de3333f05e32a36b76ec475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_bd6e79018657ee593329a85731c9757c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_9b424fdcf40d1339e9b6169644224b74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e830605b-8649-5321-818e-f1ecb6f47a11/e830605b-8649-5321-818e-f1ecb6f47a11_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/00/5200bb45bb3270a53bccc49d1db314ec/pa/VX83538_30a207e3e8458388f3d69573e2337341.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Profi M',
 'transmission': 'manual',
 'trim': 'Profi M',
 'year': 2017}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Saving data for VX83538: {'created_time': 1774676129.052727, 'last_price_update_time': 1774676129.052735, 'auction_closing_time': 1774714601.0}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX83538') HTTP/1.1" 204 0
2026-03-28 05:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-28 05:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-28 05:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419 to the API
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK52419>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'petrol',
 'id': 'c9408314-0b28-5ea1-924e-ff1403f012eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK52419',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 99333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3a4efa15b8a8ff11be99867ea11a0e7f.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3352add63744f4332e3854e5b9221d1c.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_af4e56a04e25a09aa9affc7a0a365e73.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_6552e3a14e1788e0e854f42b714cb87f.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_872e6369617cbdfd03fd007665f283a3.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_c39434f1f89de670b7e7f3c61a921097.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_1d01c544132b7d9f6b498bdc394a4f4f.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_8cc99711f2e5f172bbbf2a34b5488907.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_aed51d300d2b1f1862a7683e4b7b10d2.jpg',
                'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_ee220aa13b115fb93246aacd8633943a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3097197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3a4efa15b8a8ff11be99867ea11a0e7f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_3352add63744f4332e3854e5b9221d1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_af4e56a04e25a09aa9affc7a0a365e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_6552e3a14e1788e0e854f42b714cb87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_872e6369617cbdfd03fd007665f283a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_c39434f1f89de670b7e7f3c61a921097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_1d01c544132b7d9f6b498bdc394a4f4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_8cc99711f2e5f172bbbf2a34b5488907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_aed51d300d2b1f1862a7683e4b7b10d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9408314-0b28-5ea1-924e-ff1403f012eb/c9408314-0b28-5ea1-924e-ff1403f012eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/b8/92b8fa29152d47afe2e60ea0659873e3/pa/RK52419_ee220aa13b115fb93246aacd8633943a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Saving data for RK52419: {'created_time': 1774676129.399794, 'last_price_update_time': 1774676129.399806, 'auction_closing_time': 1774714236.0}
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK52419') HTTP/1.1" 204 0
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_0fea226ab409b708a55665a4e01f97d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_0fea226ab409b708a55665a4e01f97d6.jpg not downloaded yet
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: XL09941
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: GR29564
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for ZK43120: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for GZ43118: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: PG01901
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for NA32054: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: XB18292
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB18292%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for XB18292: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: VH56486
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for DJ14237: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for EV68047: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: YL20431
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 05:35:29 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 05:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT54020> (referer: https://www.auto1.com/v1/car-details-view/XT54020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA77246> (referer: https://www.auto1.com/v1/car-details-view/EA77246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg not downloaded yet
2026-03-28 05:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_6e7e91f1499fa385163c124e82f95241.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_6e7e91f1499fa385163c124e82f95241.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_b10c260c323bbece0ded5274333d0d25.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_b10c260c323bbece0ded5274333d0d25.jpg not downloaded yet
2026-03-28 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-28 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db with scrape type 1
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_06b82b0b8b623db8695436609dc01b6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_06b82b0b8b623db8695436609dc01b6c.jpg not downloaded yet
2026-03-28 05:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-28 05:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f494d46-eb77-5a45-be61-7ba37633c437 with scrape type 1
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_4c93a114051b41d06fffe13bd78acce8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4c93a114051b41d06fffe13bd78acce8.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_02fd64d2204e9c7954995705cd1054da.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_02fd64d2204e9c7954995705cd1054da.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_aa0f7889187b2970127e41d0408fc451.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_aa0f7889187b2970127e41d0408fc451.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_8cca6b6a656405549950c2fa90d368c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_8cca6b6a656405549950c2fa90d368c4.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_ff330b7d8986ed982951ea9113aaf375.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_ff330b7d8986ed982951ea9113aaf375.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_fd92e69439a6d30e20790e0044ceb42f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_fd92e69439a6d30e20790e0044ceb42f.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_1106b2a46911b6328cd574c07458e902.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1106b2a46911b6328cd574c07458e902.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_71c5855f470abbc15d05cb412d0cac96.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_71c5855f470abbc15d05cb412d0cac96.jpg not downloaded yet
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg not downloaded yet
2026-03-28 05:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_6e7e91f1499fa385163c124e82f95241.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_b10c260c323bbece0ded5274333d0d25.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg not downloaded yet
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_2c094e03d69760c7b619348009bad050.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_0fea226ab409b708a55665a4e01f97d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg not downloaded yet
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_4b129c81758d89c77389d55830f1f9c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4b129c81758d89c77389d55830f1f9c3.jpg not downloaded yet
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_06b82b0b8b623db8695436609dc01b6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_fd92e69439a6d30e20790e0044ceb42f.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e0fe4bd0>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2111
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4c93a114051b41d06fffe13bd78acce8.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_ff330b7d8986ed982951ea9113aaf375.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dae17cd0>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_6e7e91f1499fa385163c124e82f95241.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_6e7e91f1499fa385163c124e82f95241.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafdead0>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_b10c260c323bbece0ded5274333d0d25.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_b10c260c323bbece0ded5274333d0d25.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf11a50>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_2c094e03d69760c7b619348009bad050.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_2c094e03d69760c7b619348009bad050.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dae22c10>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Faa%252Fa9aa66b5ab0bf3bdff9720c3fb3f5139%252Fpa%252FWE30814_0fea226ab409b708a55665a4e01f97d6.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_0fea226ab409b708a55665a4e01f97d6.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8
2026-03-28 05:35:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8, skipping ID generation
2026-03-28 05:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with scrape type 1
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 sending to next pipeline
2026-03-28 05:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8, identifier: WE30814
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e134d890>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_06b82b0b8b623db8695436609dc01b6c.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_06b82b0b8b623db8695436609dc01b6c.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dae1bd10>
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_fd92e69439a6d30e20790e0044ceb42f.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_fd92e69439a6d30e20790e0044ceb42f.jpg saved to cache
2026-03-28 05:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND29954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-28 05:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-28 05:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814 to the API
2026-03-28 05:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_0fea226ab409b708a55665a4e01f97d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:12:17Z',
 'fuel_type': 'petrol',
 'id': '17033710-d847-5cf8-bb1b-a9fef1a5eeb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE30814',
 'listing': 'auction',
 'location': 'DE, Laatzen',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 164117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_2c094e03d69760c7b619348009bad050.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_0fea226ab409b708a55665a4e01f97d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_5c725b50f6ec1cac6d2ac79db09b3475.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_6e7e91f1499fa385163c124e82f95241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17033710-d847-5cf8-bb1b-a9fef1a5eeb8/17033710-d847-5cf8-bb1b-a9fef1a5eeb8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/aa/a9aa66b5ab0bf3bdff9720c3fb3f5139/pa/WE30814_b10c260c323bbece0ded5274333d0d25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-28 05:35:31 [auto1.de] INFO: Saving data for WE30814: {'created_time': 1774676131.403331, 'last_price_update_time': 1774676131.403343, 'auction_closing_time': 1774714337.0}
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE30814') HTTP/1.1" 204 0
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_8cca6b6a656405549950c2fa90d368c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC15308/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD15904> (referer: https://www.auto1.com/v1/car-details-view/SD15904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf12e10>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_4c93a114051b41d06fffe13bd78acce8.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4c93a114051b41d06fffe13bd78acce8.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e01b2910>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_ff330b7d8986ed982951ea9113aaf375.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_ff330b7d8986ed982951ea9113aaf375.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e067db50>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN04984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL38868> (referer: https://www.auto1.com/v1/car-details-view/KL38868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CB43306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e01b1050>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_8cca6b6a656405549950c2fa90d368c4.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_8cca6b6a656405549950c2fa90d368c4.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22da515dd0>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22da51e650>
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg saved to cache
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:31 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6063a52-404c-5dea-8418-17a4cd2d7620 with identifier: SD15904
2026-03-28 05:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6063a52-404c-5dea-8418-17a4cd2d7620 with scrape type 1
2026-03-28 05:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6063a52-404c-5dea-8418-17a4cd2d7620
2026-03-28 05:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_7cc85443576790b5c5c82abafbc63b8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7cc85443576790b5c5c82abafbc63b8a.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_dd3b228c859077a47592558c68ef4f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_dd3b228c859077a47592558c68ef4f16.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_04b2b0e9bc7943c8e34f8ee133bd1afc.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_04b2b0e9bc7943c8e34f8ee133bd1afc.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_7b3be6e956e88f4de2cf51f763e9ae9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7b3be6e956e88f4de2cf51f763e9ae9f.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_e70a62425dbc1358678ccfbb01a5009e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_e70a62425dbc1358678ccfbb01a5009e.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_6583e1a930efaf80e15bc7543515d9b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_6583e1a930efaf80e15bc7543515d9b9.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_75f254196a8306fa84eeec679340e5cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_75f254196a8306fa84eeec679340e5cd.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_741ec6b98774fc80f0f2118adce7d52c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_741ec6b98774fc80f0f2118adce7d52c.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_7095eae1ebbab00a60e63c491e6e21ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7095eae1ebbab00a60e63c491e6e21ae.jpg already downloaded
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F0c%252Fef0ca174ba62ddaee321a15acbfe3fa9%252Fpa%252FSD15904_43674b67c9d525e095a52b9ca3c71799.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_43674b67c9d525e095a52b9ca3c71799.jpg already downloaded
2026-03-28 05:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6063a52-404c-5dea-8418-17a4cd2d7620, identifier: SD15904
2026-03-28 05:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6063a52-404c-5dea-8418-17a4cd2d7620 with identifier: SD15904
2026-03-28 05:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6063a52-404c-5dea-8418-17a4cd2d7620 with identifier: SD15904
2026-03-28 05:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6063a52-404c-5dea-8418-17a4cd2d7620 with identifier: SD15904 to the API
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD15904>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:43:00Z',
 'fuel_type': 'petrol',
 'id': 'e6063a52-404c-5dea-8418-17a4cd2d7620',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD15904',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Mazda',
 'model': '2',
 'odometer': 104744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7cc85443576790b5c5c82abafbc63b8a.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_dd3b228c859077a47592558c68ef4f16.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_04b2b0e9bc7943c8e34f8ee133bd1afc.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7b3be6e956e88f4de2cf51f763e9ae9f.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_e70a62425dbc1358678ccfbb01a5009e.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_6583e1a930efaf80e15bc7543515d9b9.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_75f254196a8306fa84eeec679340e5cd.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_741ec6b98774fc80f0f2118adce7d52c.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7095eae1ebbab00a60e63c491e6e21ae.jpg',
                'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_43674b67c9d525e095a52b9ca3c71799.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7cc85443576790b5c5c82abafbc63b8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_dd3b228c859077a47592558c68ef4f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_04b2b0e9bc7943c8e34f8ee133bd1afc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7b3be6e956e88f4de2cf51f763e9ae9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_e70a62425dbc1358678ccfbb01a5009e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_6583e1a930efaf80e15bc7543515d9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_75f254196a8306fa84eeec679340e5cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_741ec6b98774fc80f0f2118adce7d52c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_7095eae1ebbab00a60e63c491e6e21ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6063a52-404c-5dea-8418-17a4cd2d7620/e6063a52-404c-5dea-8418-17a4cd2d7620_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/0c/ef0ca174ba62ddaee321a15acbfe3fa9/pa/SD15904_43674b67c9d525e095a52b9ca3c71799.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2017}
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Saving data for SD15904: {'created_time': 1774676132.647154, 'last_price_update_time': 1774676132.647164, 'auction_closing_time': 1774716180.0}
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD15904') HTTP/1.1" 204 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for DB13775: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for UK49641: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for HD93241: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for JP54532: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW08152%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for NW08152: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: TY55023
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for VU36237: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: KR71178
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR71178%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for KR71178: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: PK60768
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK60768%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for PK60768: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: FK75470
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for ZS55646: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for UT75774: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for WC28097: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for XW71594: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: ZA94755
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94755%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for ZA94755: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: BM57132
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: LF00683
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for ZK01329: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-28 05:35:32 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-28 05:35:32 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 05:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for EJ80176: 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for SG14649: 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Scrape type for GX32204: 0
2026-03-28 05:35:33 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 05:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_02fd64d2204e9c7954995705cd1054da.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caba45e7-8237-58f7-abe6-6e2e4f21968c with identifier: KL38868
2026-03-28 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caba45e7-8237-58f7-abe6-6e2e4f21968c with scrape type 1
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item caba45e7-8237-58f7-abe6-6e2e4f21968c
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_39ecceb8735ebacdd9566b14ef2de080.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_39ecceb8735ebacdd9566b14ef2de080.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_8bf969a85762351329be4e0a5ff3dafd.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_8bf969a85762351329be4e0a5ff3dafd.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_6bd787a0393ce2e2943e43a1b3d736d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_6bd787a0393ce2e2943e43a1b3d736d9.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_5e208782967c94c393180b86af56d3cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_5e208782967c94c393180b86af56d3cb.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_86f47d3960e18c1a56a1810682f9190b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_86f47d3960e18c1a56a1810682f9190b.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_598c0cb24c4c8000fd87beab966594d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_598c0cb24c4c8000fd87beab966594d5.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_c9c1a62d9e453faeb3fc178e613b4240.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c9c1a62d9e453faeb3fc178e613b4240.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_aa31e8a029962ca064f955d587953f32.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_aa31e8a029962ca064f955d587953f32.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_c70f720d4986c6bda377b18f8f8eee6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c70f720d4986c6bda377b18f8f8eee6f.jpg already downloaded
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5d%252F58%252F5d58a9bd3c24b8593afa3fec68dc49f4%252Fpa%252FKL38868_9c61d5751f4c16de56e860cbadcc17c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_9c61d5751f4c16de56e860cbadcc17c0.jpg already downloaded
2026-03-28 05:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caba45e7-8237-58f7-abe6-6e2e4f21968c, identifier: KL38868
2026-03-28 05:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caba45e7-8237-58f7-abe6-6e2e4f21968c with identifier: KL38868
2026-03-28 05:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caba45e7-8237-58f7-abe6-6e2e4f21968c with identifier: KL38868
2026-03-28 05:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caba45e7-8237-58f7-abe6-6e2e4f21968c with identifier: KL38868 to the API
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL38868>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:46:45Z',
 'fuel_type': 'petrol',
 'id': 'caba45e7-8237-58f7-abe6-6e2e4f21968c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL38868',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 48465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_39ecceb8735ebacdd9566b14ef2de080.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_8bf969a85762351329be4e0a5ff3dafd.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_6bd787a0393ce2e2943e43a1b3d736d9.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_5e208782967c94c393180b86af56d3cb.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_86f47d3960e18c1a56a1810682f9190b.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_598c0cb24c4c8000fd87beab966594d5.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c9c1a62d9e453faeb3fc178e613b4240.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_aa31e8a029962ca064f955d587953f32.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c70f720d4986c6bda377b18f8f8eee6f.jpg',
                'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_9c61d5751f4c16de56e860cbadcc17c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_39ecceb8735ebacdd9566b14ef2de080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_8bf969a85762351329be4e0a5ff3dafd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_6bd787a0393ce2e2943e43a1b3d736d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_5e208782967c94c393180b86af56d3cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_86f47d3960e18c1a56a1810682f9190b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_598c0cb24c4c8000fd87beab966594d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c9c1a62d9e453faeb3fc178e613b4240.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_aa31e8a029962ca064f955d587953f32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_c70f720d4986c6bda377b18f8f8eee6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caba45e7-8237-58f7-abe6-6e2e4f21968c/caba45e7-8237-58f7-abe6-6e2e4f21968c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5d/58/5d58a9bd3c24b8593afa3fec68dc49f4/pa/KL38868_9c61d5751f4c16de56e860cbadcc17c0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-28 05:35:33 [auto1.de] INFO: Saving data for KL38868: {'created_time': 1774676133.680135, 'last_price_update_time': 1774676133.680144, 'auction_closing_time': 1774716405.0}
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL38868') HTTP/1.1" 204 0
2026-03-28 05:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dae3e810>
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg saved to cache
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dae855d0>
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Fd8%252Ffdd8458ea568f3e5699c57356e879b5c%252Fpa%252FXT54020_02fd64d2204e9c7954995705cd1054da.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_02fd64d2204e9c7954995705cd1054da.jpg saved to cache
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db
2026-03-28 05:35:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d08b5941-36c8-5e68-8b74-0f32ebe7b3db, skipping ID generation
2026-03-28 05:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db with scrape type 1
2026-03-28 05:35:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db sending to next pipeline
2026-03-28 05:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d08b5941-36c8-5e68-8b74-0f32ebe7b3db, identifier: XT54020
2026-03-28 05:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-28 05:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-28 05:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020 to the API
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_02fd64d2204e9c7954995705cd1054da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:17:36Z',
 'fuel_type': 'petrol',
 'id': 'd08b5941-36c8-5e68-8b74-0f32ebe7b3db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT54020',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 210184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_06b82b0b8b623db8695436609dc01b6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_02fd64d2204e9c7954995705cd1054da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_1b0af7879d46ea6b2b3c58f40417f546.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_25d89a8be4b14d4bab751c13ac5f77de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d08b5941-36c8-5e68-8b74-0f32ebe7b3db/d08b5941-36c8-5e68-8b74-0f32ebe7b3db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/d8/fdd8458ea568f3e5699c57356e879b5c/pa/XT54020_fd92e69439a6d30e20790e0044ceb42f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2005}
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-28 05:35:34 [auto1.de] INFO: Saving data for XT54020: {'created_time': 1774676134.389799, 'last_price_update_time': 1774676134.389809, 'auction_closing_time': 1774714656.0}
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT54020') HTTP/1.1" 204 0
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1106b2a46911b6328cd574c07458e902.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_71c5855f470abbc15d05cb412d0cac96.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_aa0f7889187b2970127e41d0408fc451.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4b129c81758d89c77389d55830f1f9c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafa4f50>
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg saved to cache
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e0207290>
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_1106b2a46911b6328cd574c07458e902.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1106b2a46911b6328cd574c07458e902.jpg saved to cache
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daed4890>
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_71c5855f470abbc15d05cb412d0cac96.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_71c5855f470abbc15d05cb412d0cac96.jpg saved to cache
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e00b8590>
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_aa0f7889187b2970127e41d0408fc451.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_aa0f7889187b2970127e41d0408fc451.jpg saved to cache
2026-03-28 05:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e127bd90>
2026-03-28 05:35:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F3e%252Fa63e397c7beb52817d631022b162eae7%252Fpa%252FEA77246_4b129c81758d89c77389d55830f1f9c3.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4b129c81758d89c77389d55830f1f9c3.jpg saved to cache
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f494d46-eb77-5a45-be61-7ba37633c437
2026-03-28 05:35:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f494d46-eb77-5a45-be61-7ba37633c437, skipping ID generation
2026-03-28 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f494d46-eb77-5a45-be61-7ba37633c437 with scrape type 1
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f494d46-eb77-5a45-be61-7ba37633c437 sending to next pipeline
2026-03-28 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f494d46-eb77-5a45-be61-7ba37633c437, identifier: EA77246
2026-03-28 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-28 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-28 05:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246 to the API
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4b129c81758d89c77389d55830f1f9c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 216,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:52Z',
 'fuel_type': 'diesel',
 'id': '1f494d46-eb77-5a45-be61-7ba37633c437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA77246',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 265928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4c93a114051b41d06fffe13bd78acce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_aa0f7889187b2970127e41d0408fc451.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_8cca6b6a656405549950c2fa90d368c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_ff330b7d8986ed982951ea9113aaf375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2369250,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1106b2a46911b6328cd574c07458e902.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2452256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_71c5855f470abbc15d05cb412d0cac96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304242,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_d1ca68f8ddcde55de94bc33491c3edca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_1c9ebb5d34f11feb08ebbdf4885c36b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_3b89c5043cebf5a2c0c557ce28823c62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f494d46-eb77-5a45-be61-7ba37633c437/1f494d46-eb77-5a45-be61-7ba37633c437_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490331,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/3e/a63e397c7beb52817d631022b162eae7/pa/EA77246_4b129c81758d89c77389d55830f1f9c3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend',
 'transmission': 'automatic',
 'trim': 'lang Trend',
 'year': 2011}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [auto1.de] INFO: Saving data for EA77246: {'created_time': 1774676135.556088, 'last_price_update_time': 1774676135.556098, 'auction_closing_time': 1774714972.0}
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA77246') HTTP/1.1" 204 0
2026-03-28 05:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN04984> (referer: https://www.auto1.com/v1/car-details-view/TN04984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC15308> (referer: https://www.auto1.com/v1/car-details-view/PC15308/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-28 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with scrape type 1
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd1%252Fb0d1c1750fe3e3a5d9e4c8a29070462e%252Fpa%252FTN04984_9e8647219ead967bd622292f3d88e531.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_9e8647219ead967bd622292f3d88e531.jpg already downloaded
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd1%252Fb0d1c1750fe3e3a5d9e4c8a29070462e%252Fpa%252FTN04984_f8ae4cedcfe40ebc8316b2386c961586.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_f8ae4cedcfe40ebc8316b2386c961586.jpg already downloaded
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd1%252Fb0d1c1750fe3e3a5d9e4c8a29070462e%252Fpa%252FTN04984_81e3b3b49803fa11ff0e771b21e696da.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_81e3b3b49803fa11ff0e771b21e696da.jpg already downloaded
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd1%252Fb0d1c1750fe3e3a5d9e4c8a29070462e%252Fpa%252FTN04984_65a75ffb2f3d37e287a08b19f9dcbab0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_65a75ffb2f3d37e287a08b19f9dcbab0.jpg already downloaded
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252Fd1%252Fb0d1c1750fe3e3a5d9e4c8a29070462e%252Fpa%252FTN04984_12a664a5b6c7858206194471d1b968d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_12a664a5b6c7858206194471d1b968d7.jpg already downloaded
2026-03-28 05:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5, identifier: TN04984
2026-03-28 05:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21a32c77-e21e-50bf-b351-391a71f52aa5 with identifier: PC15308
2026-03-28 05:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a32c77-e21e-50bf-b351-391a71f52aa5 with scrape type 1
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_9797abd73aad7955b62bd772c59dcdee.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_9797abd73aad7955b62bd772c59dcdee.jpg not downloaded yet
2026-03-28 05:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-28 05:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-28 05:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984 to the API
2026-03-28 05:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TN04984>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.2L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:09:42Z',
 'fuel_type': 'petrol',
 'id': '7a0bf0d6-50b7-5421-abeb-33e83e9e66b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN04984',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Chrysler',
 'model': 'Crossfire',
 'odometer': 344936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_9e8647219ead967bd622292f3d88e531.jpg',
                'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_f8ae4cedcfe40ebc8316b2386c961586.jpg',
                'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_81e3b3b49803fa11ff0e771b21e696da.jpg',
                'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_65a75ffb2f3d37e287a08b19f9dcbab0.jpg',
                'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_12a664a5b6c7858206194471d1b968d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0bf0d6-50b7-5421-abeb-33e83e9e66b5/7a0bf0d6-50b7-5421-abeb-33e83e9e66b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_9e8647219ead967bd622292f3d88e531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0bf0d6-50b7-5421-abeb-33e83e9e66b5/7a0bf0d6-50b7-5421-abeb-33e83e9e66b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_f8ae4cedcfe40ebc8316b2386c961586.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0bf0d6-50b7-5421-abeb-33e83e9e66b5/7a0bf0d6-50b7-5421-abeb-33e83e9e66b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_81e3b3b49803fa11ff0e771b21e696da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0bf0d6-50b7-5421-abeb-33e83e9e66b5/7a0bf0d6-50b7-5421-abeb-33e83e9e66b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_65a75ffb2f3d37e287a08b19f9dcbab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a0bf0d6-50b7-5421-abeb-33e83e9e66b5/7a0bf0d6-50b7-5421-abeb-33e83e9e66b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/d1/b0d1c1750fe3e3a5d9e4c8a29070462e/pa/TN04984_12a664a5b6c7858206194471d1b968d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-09-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Chrysler Crossfire 3.2 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2004}
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Saving data for TN04984: {'created_time': 1774676136.214462, 'last_price_update_time': 1774676136.214473, 'auction_closing_time': 1774714182.0}
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN04984') HTTP/1.1" 204 0
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg not downloaded yet
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg not downloaded yet
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg not downloaded yet
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CB43306> (referer: https://www.auto1.com/v1/car-details-view/CB43306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_739f1b670e518eba7985cf2bc94ef608.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_739f1b670e518eba7985cf2bc94ef608.jpg not downloaded yet
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_1bf27190641252a37f9a3d60195ac60c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_1bf27190641252a37f9a3d60195ac60c.jpg not downloaded yet
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg not downloaded yet
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_9797abd73aad7955b62bd772c59dcdee.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_00afb290a86043d07d89f4a342822db1.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_00afb290a86043d07d89f4a342822db1.jpg not downloaded yet
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_f66890f0e20b11040ecb926d8310e5da.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_f66890f0e20b11040ecb926d8310e5da.jpg not downloaded yet
2026-03-28 05:35:36 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_76ca9f9b065bc547adc50c2b6307a181.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_76ca9f9b065bc547adc50c2b6307a181.jpg not downloaded yet
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for UZ43781: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for AW80903: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for KA91193: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: LU01716
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU01716%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for LU01716: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ES71771
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for BD76424: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BL23866
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL23866%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for BL23866: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for BJ94385: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for KV57112: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for EM80186: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for BX45513: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for VF70690: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for VF27254: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: LW02583
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW02583%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for LW02583: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for YT00833: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for YM15583: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for SN13100: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for CV30078: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for DV57223: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BC73900
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for PU94869: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: CF34401
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF34401%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for CF34401: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: TJ50695
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50695%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for TJ50695: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for SV05588: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: JB03080
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: BX84490
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX84490%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [auto1.de] INFO: Scrape type for BX84490: 0
2026-03-28 05:35:36 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 05:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_739f1b670e518eba7985cf2bc94ef608.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d734f799-0de9-56aa-9265-2fadd8766878 with identifier: CB43306
2026-03-28 05:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d734f799-0de9-56aa-9265-2fadd8766878 with scrape type 1
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d734f799-0de9-56aa-9265-2fadd8766878
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_2b40d1d524b5b05e50fa472d6968461b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_2b40d1d524b5b05e50fa472d6968461b.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_ccd54390b64f03e38fbaa50c08818c95.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_ccd54390b64f03e38fbaa50c08818c95.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_e9bf9ee51cfca8fca6fcd47404ee1f7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_e9bf9ee51cfca8fca6fcd47404ee1f7d.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_393b351ffbb024b147559d93a7670e03.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_393b351ffbb024b147559d93a7670e03.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_8d429749d6543c2f8882159a41477bd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8d429749d6543c2f8882159a41477bd7.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_8ea67eeb7de34f9fce13cc4b4cd4e48e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8ea67eeb7de34f9fce13cc4b4cd4e48e.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_5084c208aacd5c90696fc555dc3a6b23.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_5084c208aacd5c90696fc555dc3a6b23.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_42a91844209958d1395dc5cb73e830a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_42a91844209958d1395dc5cb73e830a1.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_05e3f356fddaa41551e8848a895e270c.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_05e3f356fddaa41551e8848a895e270c.jpg already downloaded
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F30%252F7f30f81a02f0a87258e1fb9a7dd6fc7f%252Fpa%252FCB43306_14c257f9c91eb89c42db9605134a9c6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_14c257f9c91eb89c42db9605134a9c6a.jpg already downloaded
2026-03-28 05:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d734f799-0de9-56aa-9265-2fadd8766878, identifier: CB43306
2026-03-28 05:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND29954> (referer: https://www.auto1.com/v1/car-details-view/ND29954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d734f799-0de9-56aa-9265-2fadd8766878 with identifier: CB43306
2026-03-28 05:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d734f799-0de9-56aa-9265-2fadd8766878 with identifier: CB43306
2026-03-28 05:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d734f799-0de9-56aa-9265-2fadd8766878 with identifier: CB43306 to the API
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CB43306>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:32:12Z',
 'fuel_type': 'petrol',
 'id': 'd734f799-0de9-56aa-9265-2fadd8766878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB43306',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 41648,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_2b40d1d524b5b05e50fa472d6968461b.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_ccd54390b64f03e38fbaa50c08818c95.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_e9bf9ee51cfca8fca6fcd47404ee1f7d.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_393b351ffbb024b147559d93a7670e03.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8d429749d6543c2f8882159a41477bd7.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8ea67eeb7de34f9fce13cc4b4cd4e48e.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_5084c208aacd5c90696fc555dc3a6b23.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_42a91844209958d1395dc5cb73e830a1.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_05e3f356fddaa41551e8848a895e270c.jpg',
                'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_14c257f9c91eb89c42db9605134a9c6a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_2b40d1d524b5b05e50fa472d6968461b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_ccd54390b64f03e38fbaa50c08818c95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_e9bf9ee51cfca8fca6fcd47404ee1f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_393b351ffbb024b147559d93a7670e03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8d429749d6543c2f8882159a41477bd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_8ea67eeb7de34f9fce13cc4b4cd4e48e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_5084c208aacd5c90696fc555dc3a6b23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_42a91844209958d1395dc5cb73e830a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_05e3f356fddaa41551e8848a895e270c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d734f799-0de9-56aa-9265-2fadd8766878/d734f799-0de9-56aa-9265-2fadd8766878_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/30/7f30f81a02f0a87258e1fb9a7dd6fc7f/pa/CB43306_14c257f9c91eb89c42db9605134a9c6a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2023}
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB43306%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [auto1.de] INFO: Saving data for CB43306: {'created_time': 1774676137.412477, 'last_price_update_time': 1774676137.412488, 'auction_closing_time': 1774715532.0}
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB43306') HTTP/1.1" 204 0
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf64dd0>
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_9797abd73aad7955b62bd772c59dcdee.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_9797abd73aad7955b62bd772c59dcdee.jpg saved to cache
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_f66890f0e20b11040ecb926d8310e5da.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e01f9f10>
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_739f1b670e518eba7985cf2bc94ef608.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_739f1b670e518eba7985cf2bc94ef608.jpg saved to cache
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafb13d0>
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg saved to cache
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e01f0e50>
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg saved to cache
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-28 05:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e45b833-9630-5747-95b9-9bb7acda68cd with scrape type 1
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e45b833-9630-5747-95b9-9bb7acda68cd
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_1fc828dbfaea9e5e1be328972c72e6e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_1fc828dbfaea9e5e1be328972c72e6e8.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_5a058accaff1043362e17e4e45dcd0f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_5a058accaff1043362e17e4e45dcd0f9.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_725a0aac0a3bcf1c99a1d14345621557.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_725a0aac0a3bcf1c99a1d14345621557.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_3bd32ea8e64ce7c0d6e74f23663a1199.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_3bd32ea8e64ce7c0d6e74f23663a1199.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_18bc27aac35a931d07d3951ecdf6c592.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_18bc27aac35a931d07d3951ecdf6c592.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_8195d601eceb1e342e734a622bf29f39.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_8195d601eceb1e342e734a622bf29f39.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_390c6d0cb24510465d6ebdd0783a3335.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_390c6d0cb24510465d6ebdd0783a3335.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_a616707288c8a4d79a1c7ccd55378568.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_a616707288c8a4d79a1c7ccd55378568.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_2f8ee96784553c292587d8f870a1a074.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_2f8ee96784553c292587d8f870a1a074.jpg already downloaded
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F7d%252F607df4475801b6326c3742c29c1db293%252Fpa%252FND29954_54681d0b79600af7a90ee47935ffa09f.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_54681d0b79600af7a90ee47935ffa09f.jpg already downloaded
2026-03-28 05:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e45b833-9630-5747-95b9-9bb7acda68cd, identifier: ND29954
2026-03-28 05:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-28 05:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-28 05:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954 to the API
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ND29954>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:34Z',
 'fuel_type': 'petrol',
 'id': '4e45b833-9630-5747-95b9-9bb7acda68cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND29954',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 42240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_1fc828dbfaea9e5e1be328972c72e6e8.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_5a058accaff1043362e17e4e45dcd0f9.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_725a0aac0a3bcf1c99a1d14345621557.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_3bd32ea8e64ce7c0d6e74f23663a1199.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_18bc27aac35a931d07d3951ecdf6c592.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_8195d601eceb1e342e734a622bf29f39.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_390c6d0cb24510465d6ebdd0783a3335.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_a616707288c8a4d79a1c7ccd55378568.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_2f8ee96784553c292587d8f870a1a074.jpg',
                'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_54681d0b79600af7a90ee47935ffa09f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_1fc828dbfaea9e5e1be328972c72e6e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_5a058accaff1043362e17e4e45dcd0f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_725a0aac0a3bcf1c99a1d14345621557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_3bd32ea8e64ce7c0d6e74f23663a1199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_18bc27aac35a931d07d3951ecdf6c592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_8195d601eceb1e342e734a622bf29f39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_390c6d0cb24510465d6ebdd0783a3335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_a616707288c8a4d79a1c7ccd55378568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3247596,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_2f8ee96784553c292587d8f870a1a074.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e45b833-9630-5747-95b9-9bb7acda68cd/4e45b833-9630-5747-95b9-9bb7acda68cd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/7d/607df4475801b6326c3742c29c1db293/pa/ND29954_54681d0b79600af7a90ee47935ffa09f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-28 05:35:38 [auto1.de] INFO: Saving data for ND29954: {'created_time': 1774676138.309276, 'last_price_update_time': 1774676138.309286, 'auction_closing_time': 1774713934.0}
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND29954') HTTP/1.1" 204 0
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf716d0>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_f66890f0e20b11040ecb926d8310e5da.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_f66890f0e20b11040ecb926d8310e5da.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_1bf27190641252a37f9a3d60195ac60c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_00afb290a86043d07d89f4a342822db1.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_76ca9f9b065bc547adc50c2b6307a181.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafa4590>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_1bf27190641252a37f9a3d60195ac60c.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_1bf27190641252a37f9a3d60195ac60c.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf78a90>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_00afb290a86043d07d89f4a342822db1.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_00afb290a86043d07d89f4a342822db1.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafd1e90>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf44390>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e0115290>
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:35:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F0a%252F690a421c7ad62af59c4ce9696dc61a78%252Fpa%252FPC15308_76ca9f9b065bc547adc50c2b6307a181.jpg') HTTP/1.1" 204 0
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_76ca9f9b065bc547adc50c2b6307a181.jpg saved to cache
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21a32c77-e21e-50bf-b351-391a71f52aa5
2026-03-28 05:35:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21a32c77-e21e-50bf-b351-391a71f52aa5, skipping ID generation
2026-03-28 05:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21a32c77-e21e-50bf-b351-391a71f52aa5 with scrape type 1
2026-03-28 05:35:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21a32c77-e21e-50bf-b351-391a71f52aa5 sending to next pipeline
2026-03-28 05:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21a32c77-e21e-50bf-b351-391a71f52aa5, identifier: PC15308
2026-03-28 05:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21a32c77-e21e-50bf-b351-391a71f52aa5 with identifier: PC15308
2026-03-28 05:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21a32c77-e21e-50bf-b351-391a71f52aa5 with identifier: PC15308
2026-03-28 05:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21a32c77-e21e-50bf-b351-391a71f52aa5 with identifier: PC15308 to the API
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_76ca9f9b065bc547adc50c2b6307a181.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'petrol',
 'id': '21a32c77-e21e-50bf-b351-391a71f52aa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC15308',
 'listing': 'auction',
 'location': 'DE, Gera',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 60895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_9797abd73aad7955b62bd772c59dcdee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_c6e14aa0bf31ccae263b6be13ad99e72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_2f725ee4cd25f5432d47706f68ac1fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_530209158e2ba80b0b3c9c10fe82bdcd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_739f1b670e518eba7985cf2bc94ef608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1882883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_1bf27190641252a37f9a3d60195ac60c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1975841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_e2a1ca2b22416c514c46f2b0b208dc7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1946877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_00afb290a86043d07d89f4a342822db1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_f66890f0e20b11040ecb926d8310e5da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21a32c77-e21e-50bf-b351-391a71f52aa5/21a32c77-e21e-50bf-b351-391a71f52aa5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510593,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/0a/690a421c7ad62af59c4ce9696dc61a78/pa/PC15308_76ca9f9b065bc547adc50c2b6307a181.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC15308%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Saving data for PC15308: {'created_time': 1774676139.442895, 'last_price_update_time': 1774676139.442905, 'auction_closing_time': 1774714192.0}
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC15308') HTTP/1.1" 204 0
2026-03-28 05:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:39 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:39 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-28 05:35:39 [auto1.de] INFO: Scrape type for ZA25327: 2
2026-03-28 05:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-28 05:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e906ecf4-da75-50bf-82a9-e0f59b071cce with scrape type 2
2026-03-28 05:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e906ecf4-da75-50bf-82a9-e0f59b071cce with scrape type 2
2026-03-28 05:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e906ecf4-da75-50bf-82a9-e0f59b071cce, identifier: ZA25327
2026-03-28 05:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 05:35:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-28 05:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327 to the API
2026-03-28 05:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:44Z',
 'fuel_type': 'petrol',
 'id': 'e906ecf4-da75-50bf-82a9-e0f59b071cce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA25327',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-18',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Saving data for ZA25327: {'auction_closing_time': 1774715924.0, 'created_time': 1774552959.745301, 'last_price_update_time': 1774676140.145415}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA25327') HTTP/1.1" 204 0
2026-03-28 05:35:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: WN78953
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN78953%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for WN78953: 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for LK11873: 2
2026-03-28 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-28 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a34cfe0-9560-545a-80f8-03e216fde40d with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a34cfe0-9560-545a-80f8-03e216fde40d with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a34cfe0-9560-545a-80f8-03e216fde40d, identifier: LK11873
2026-03-28 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-28 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873
2026-03-28 05:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a34cfe0-9560-545a-80f8-03e216fde40d with identifier: LK11873 to the API
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:24Z',
 'fuel_type': 'petrol',
 'id': '8a34cfe0-9560-545a-80f8-03e216fde40d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK11873',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 58017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Fiat 500C 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2019}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Saving data for LK11873: {'auction_closing_time': 1774715604.0, 'created_time': 1774551130.585278, 'last_price_update_time': 1774676140.640669}
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK11873') HTTP/1.1" 204 0
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 05:35:40 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-28 05:35:40 [auto1.de] INFO: Scrape type for RV72396: 2
2026-03-28 05:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-28 05:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with scrape type 2
2026-03-28 05:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8, identifier: RV72396
2026-03-28 05:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-28 05:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396
2026-03-28 05:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5016cdf8-4bd5-5c19-92de-7be462f5a7d8 with identifier: RV72396 to the API
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:06Z',
 'fuel_type': 'diesel',
 'id': '5016cdf8-4bd5-5c19-92de-7be462f5a7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV72396',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 145300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Saving data for RV72396: {'auction_closing_time': 1774714506.0, 'created_time': 1774550963.353392, 'last_price_update_time': 1774676141.079789}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV72396') HTTP/1.1" 204 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for GU59921: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for HC05500: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for ZZ74816: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for LW69749: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: US80422
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: PT81220
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for AH85059: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for LK78678: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for YJ68996: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15479%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for TB15479: 2
2026-03-28 05:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c390955e-1dd6-5773-9d0e-4345c2f26cb8 with identifier: TB15479
2026-03-28 05:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c390955e-1dd6-5773-9d0e-4345c2f26cb8 with scrape type 2
2026-03-28 05:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c390955e-1dd6-5773-9d0e-4345c2f26cb8 with scrape type 2
2026-03-28 05:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c390955e-1dd6-5773-9d0e-4345c2f26cb8, identifier: TB15479
2026-03-28 05:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c390955e-1dd6-5773-9d0e-4345c2f26cb8 with identifier: TB15479
2026-03-28 05:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c390955e-1dd6-5773-9d0e-4345c2f26cb8 with identifier: TB15479
2026-03-28 05:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c390955e-1dd6-5773-9d0e-4345c2f26cb8 with identifier: TB15479 to the API
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:04:36Z',
 'fuel_type': 'diesel',
 'id': 'c390955e-1dd6-5773-9d0e-4345c2f26cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB15479',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 210330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-05',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15479%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Saving data for TB15479: {'auction_closing_time': 1774713876.0, 'created_time': 1774466894.437439, 'last_price_update_time': 1774676141.728041}
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB15479') HTTP/1.1" 204 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for CS76015: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: TE23487
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for HG88982: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-28 05:35:41 [auto1.de] INFO: Scrape type for UZ43090: 0
2026-03-28 05:35:41 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 05:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY28796> (referer: https://www.auto1.com/v1/car-details-view/ZY28796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-28 05:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42ad69c-4f78-57cd-8c0b-7abbdf708747 with scrape type 1
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b42ad69c-4f78-57cd-8c0b-7abbdf708747
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_830d8ed56c69b3b9d962a3bda806ea25.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_830d8ed56c69b3b9d962a3bda806ea25.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_9acdf06cfa08cd859605e5d370934c36.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_9acdf06cfa08cd859605e5d370934c36.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_ca4ad9b4588396666514bf5f4c02113e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_ca4ad9b4588396666514bf5f4c02113e.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_075951a01dd2d1eb900897bff61c49f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_075951a01dd2d1eb900897bff61c49f4.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_c198195a213917e9edd8568adeda168b.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_c198195a213917e9edd8568adeda168b.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_2225e3c355921f1b00a6e6789e939de0.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_2225e3c355921f1b00a6e6789e939de0.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_6beb58c9e79cdf45e76f3cba92731688.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_6beb58c9e79cdf45e76f3cba92731688.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_d8c488e382853539bb7094eddf5fd283.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_d8c488e382853539bb7094eddf5fd283.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_33b2bf236e9a45f824439d8d9ffc94b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_33b2bf236e9a45f824439d8d9ffc94b4.jpg already downloaded
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252Fe6%252Fb1e64448f2127ef51c870c587a37db8e%252Fpa%252FZY28796_bf550dfa94b5a34261d196ac1fc16d85.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_bf550dfa94b5a34261d196ac1fc16d85.jpg already downloaded
2026-03-28 05:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b42ad69c-4f78-57cd-8c0b-7abbdf708747, identifier: ZY28796
2026-03-28 05:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-28 05:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-28 05:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796 to the API
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZY28796>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:22:23Z',
 'fuel_type': 'petrol',
 'id': 'b42ad69c-4f78-57cd-8c0b-7abbdf708747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY28796',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'BMW',
 'model': '3er',
 'odometer': 77531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_830d8ed56c69b3b9d962a3bda806ea25.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_9acdf06cfa08cd859605e5d370934c36.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_ca4ad9b4588396666514bf5f4c02113e.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_075951a01dd2d1eb900897bff61c49f4.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_c198195a213917e9edd8568adeda168b.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_2225e3c355921f1b00a6e6789e939de0.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_6beb58c9e79cdf45e76f3cba92731688.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_d8c488e382853539bb7094eddf5fd283.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_33b2bf236e9a45f824439d8d9ffc94b4.jpg',
                'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_bf550dfa94b5a34261d196ac1fc16d85.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096635,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_830d8ed56c69b3b9d962a3bda806ea25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_9acdf06cfa08cd859605e5d370934c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_ca4ad9b4588396666514bf5f4c02113e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3029725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_075951a01dd2d1eb900897bff61c49f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_c198195a213917e9edd8568adeda168b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_2225e3c355921f1b00a6e6789e939de0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3220145,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_6beb58c9e79cdf45e76f3cba92731688.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_d8c488e382853539bb7094eddf5fd283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3171436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_33b2bf236e9a45f824439d8d9ffc94b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b42ad69c-4f78-57cd-8c0b-7abbdf708747/b42ad69c-4f78-57cd-8c0b-7abbdf708747_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/e6/b1e64448f2127ef51c870c587a37db8e/pa/ZY28796_bf550dfa94b5a34261d196ac1fc16d85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2021}
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Saving data for ZY28796: {'created_time': 1774676142.801674, 'last_price_update_time': 1774676142.801684, 'auction_closing_time': 1774714943.0}
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY28796') HTTP/1.1" 204 0
2026-03-28 05:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:42 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Scrape type for BU32595: 0
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Scrape type for SH55749: 0
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-28 05:35:42 [auto1.de] INFO: Scrape type for JJ68009: 0
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 05:35:42 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 05:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for EN88282: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: TC10738
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC10738%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for TC10738: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for BZ42354: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for CM58161: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for AN36712: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for RX10948: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for VH92759: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for ML67017: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for TT27495: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for CD03678: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for GX41654: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV75383%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for VV75383: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for SZ97715: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for KC37462: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: RB39093
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB39093%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for RB39093: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: FX57031
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX57031%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for FX57031: 0
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: MF29481
2026-03-28 05:35:43 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-28 05:35:43 [auto1.de] INFO: Scrape type for PM88586: 0
2026-03-28 05:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:44 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for TR13409: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for GW97412: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: GE07622
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: YB13434
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB13434%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for YB13434: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for LG84508: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: DN72961
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN72961%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for DN72961: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for MJ31328: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for XS82974: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for GH39417: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for BD21444: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for HK50070: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: AB20934
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: FX68518
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for SG14297: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: JF90132
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: CU59576
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU59576%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for CU59576: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for ER31380: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for XJ24379: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for DP78752: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: LJ89575
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for YU93919: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for CM30450: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for PT06802: 0
2026-03-28 05:35:44 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-28 05:35:44 [auto1.de] INFO: Scrape type for CH30601: 0
2026-03-28 05:35:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:45 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for MA42451: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for HK24290: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for BP81340: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: MX06399
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX06399%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for MX06399: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: XX93407
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX93407%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for XX93407: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: SE90134
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: GN38725
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN38725%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for GN38725: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: LZ73425
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: PV39921
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV39921%27 HTTP/1.1" 200 None
2026-03-28 05:35:45 [auto1.de] INFO: Scrape type for PV39921: 0
2026-03-28 05:35:45 [auto1.de] INFO: Found listing with ID: UM40776
2026-03-28 05:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM40776%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for UM40776: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: PR48691
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for WD47381: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: BX52311
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52311%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for BX52311: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: HF45615
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF45615%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for HF45615: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for MK98498: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for XB63697: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: TE36715
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for NE19972: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: EX28790
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX28790%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for EX28790: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for UB28690: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: GE34935
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE34935%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for GE34935: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for ES37621: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: LK84028
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for JM07569: 0
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: FV70322
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 05:35:46 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-28 05:35:46 [auto1.de] INFO: Scrape type for GR02584: 0
2026-03-28 05:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:47 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: RG19382
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: JB27524
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for VP25295: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: MN73743
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for NJ66077: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: XG23027
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: UV23463
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV23463%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for UV23463: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: KX75586
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for JD23265: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for GT14298: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: AZ36706
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: CC17090
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for KL53394: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB80315%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for EB80315: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW04904%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for FW04904: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK45349%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for GK45349: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-28 05:35:47 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-28 05:35:47 [auto1.de] INFO: Scrape type for BE83152: 2
2026-03-28 05:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-28 05:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671bc3fe-6eba-5a6f-9709-57a402b9b056 with scrape type 2
2026-03-28 05:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 671bc3fe-6eba-5a6f-9709-57a402b9b056 with scrape type 2
2026-03-28 05:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 671bc3fe-6eba-5a6f-9709-57a402b9b056, identifier: BE83152
2026-03-28 05:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-28 05:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-28 05:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152 to the API
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:20:02Z',
 'fuel_type': 'petrol',
 'id': '671bc3fe-6eba-5a6f-9709-57a402b9b056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE83152',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 10689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-17',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Saving data for BE83152: {'auction_closing_time': 1774714802.0, 'created_time': 1773916955.433568, 'last_price_update_time': 1774676148.254505}
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE83152') HTTP/1.1" 204 0
2026-03-28 05:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK74048%27 HTTP/1.1" 200 None
2026-03-28 05:35:48 [auto1.de] INFO: Scrape type for KK74048: 0
2026-03-28 05:35:48 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-28 05:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:49 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25179%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for TA25179: 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK99504%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for VK99504: 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK08818%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for HK08818: 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for NU04580: 0
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-28 05:35:49 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43305%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Scrape type for XK43305: 2
2026-03-28 05:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with identifier: XK43305
2026-03-28 05:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with scrape type 2
2026-03-28 05:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with scrape type 2
2026-03-28 05:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5631e1c4-ac94-535d-9ed7-9926768c7ab8, identifier: XK43305
2026-03-28 05:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with identifier: XK43305
2026-03-28 05:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with identifier: XK43305
2026-03-28 05:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5631e1c4-ac94-535d-9ed7-9926768c7ab8 with identifier: XK43305 to the API
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:32:44Z',
 'fuel_type': 'hybrid',
 'id': '5631e1c4-ac94-535d-9ed7-9926768c7ab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK43305',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 71495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300de 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43305%27 HTTP/1.1" 200 None
2026-03-28 05:35:49 [auto1.de] INFO: Saving data for XK43305: {'auction_closing_time': 1774715564.0, 'created_time': 1774463741.045237, 'last_price_update_time': 1774676149.924485}
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK43305') HTTP/1.1" 204 0
2026-03-28 05:35:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for WC33817: 2
2026-03-28 05:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-28 05:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a751389-2957-55b7-b863-421eb5c62040 with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a751389-2957-55b7-b863-421eb5c62040 with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a751389-2957-55b7-b863-421eb5c62040, identifier: WC33817
2026-03-28 05:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-28 05:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-28 05:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817 to the API
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:19Z',
 'fuel_type': 'petrol',
 'id': '9a751389-2957-55b7-b863-421eb5c62040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC33817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 84342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Saving data for WC33817: {'auction_closing_time': 1774715059.0, 'created_time': 1774550860.280691, 'last_price_update_time': 1774676150.459714}
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC33817') HTTP/1.1" 204 0
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88566%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for JZ88566: 0
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40861%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for SX40861: 2
2026-03-28 05:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4763ebfa-dc66-56ec-9b07-d7337aa1465d with identifier: SX40861
2026-03-28 05:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4763ebfa-dc66-56ec-9b07-d7337aa1465d with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4763ebfa-dc66-56ec-9b07-d7337aa1465d with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4763ebfa-dc66-56ec-9b07-d7337aa1465d, identifier: SX40861
2026-03-28 05:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4763ebfa-dc66-56ec-9b07-d7337aa1465d with identifier: SX40861
2026-03-28 05:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4763ebfa-dc66-56ec-9b07-d7337aa1465d with identifier: SX40861
2026-03-28 05:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4763ebfa-dc66-56ec-9b07-d7337aa1465d with identifier: SX40861 to the API
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:46Z',
 'fuel_type': 'diesel',
 'id': '4763ebfa-dc66-56ec-9b07-d7337aa1465d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX40861',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 119941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-16',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40861%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Saving data for SX40861: {'auction_closing_time': 1774715986.0, 'created_time': 1774552061.881921, 'last_price_update_time': 1774676150.942964}
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX40861') HTTP/1.1" 204 0
2026-03-28 05:35:50 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-28 05:35:50 [auto1.de] INFO: Scrape type for DY95504: 2
2026-03-28 05:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cb4485b-4e63-5e6a-960f-c34f964b8aab with identifier: DY95504
2026-03-28 05:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cb4485b-4e63-5e6a-960f-c34f964b8aab with scrape type 2
2026-03-28 05:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cb4485b-4e63-5e6a-960f-c34f964b8aab with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cb4485b-4e63-5e6a-960f-c34f964b8aab, identifier: DY95504
2026-03-28 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cb4485b-4e63-5e6a-960f-c34f964b8aab with identifier: DY95504
2026-03-28 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cb4485b-4e63-5e6a-960f-c34f964b8aab with identifier: DY95504
2026-03-28 05:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cb4485b-4e63-5e6a-960f-c34f964b8aab with identifier: DY95504 to the API
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'petrol',
 'id': '6cb4485b-4e63-5e6a-960f-c34f964b8aab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY95504',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 116282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Saving data for DY95504: {'auction_closing_time': 1774716206.0, 'created_time': 1774552571.356197, 'last_price_update_time': 1774676151.389904}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY95504') HTTP/1.1" 204 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: JE79416
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for PH95596: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH77373%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for LH77373: 0
2026-03-28 05:35:51 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG43365%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Scrape type for UG43365: 2
2026-03-28 05:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657a9c0d-7caa-5f70-9264-0ad809b30a70 with identifier: UG43365
2026-03-28 05:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657a9c0d-7caa-5f70-9264-0ad809b30a70 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657a9c0d-7caa-5f70-9264-0ad809b30a70 with scrape type 2
2026-03-28 05:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 657a9c0d-7caa-5f70-9264-0ad809b30a70, identifier: UG43365
2026-03-28 05:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 657a9c0d-7caa-5f70-9264-0ad809b30a70 with identifier: UG43365
2026-03-28 05:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 657a9c0d-7caa-5f70-9264-0ad809b30a70 with identifier: UG43365
2026-03-28 05:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 657a9c0d-7caa-5f70-9264-0ad809b30a70 with identifier: UG43365 to the API
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-28T16:58:41Z',
 'fuel_type': 'petrol',
 'id': '657a9c0d-7caa-5f70-9264-0ad809b30a70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG43365',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 119623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2015}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG43365%27 HTTP/1.1" 200 None
2026-03-28 05:35:51 [auto1.de] INFO: Saving data for UG43365: {'auction_closing_time': 1774717121.0, 'created_time': 1773380503.3291, 'last_price_update_time': 1774676151.887279}
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG43365') HTTP/1.1" 204 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12660%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for HP12660: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD40582%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for UD40582: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU06584%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for PU06584: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP05296%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for UP05296: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE58161%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for JE58161: 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for BB15265: 2
2026-03-28 05:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with identifier: BB15265
2026-03-28 05:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cbe1971-9f1f-52e3-bb84-3b8980be16f5, identifier: BB15265
2026-03-28 05:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with identifier: BB15265
2026-03-28 05:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with identifier: BB15265
2026-03-28 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cbe1971-9f1f-52e3-bb84-3b8980be16f5 with identifier: BB15265 to the API
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:43:30Z',
 'fuel_type': 'diesel',
 'id': '9cbe1971-9f1f-52e3-bb84-3b8980be16f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB15265',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 136110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-13',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Combi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Combi L1H1 2,7t',
 'year': 2015}
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Saving data for BB15265: {'auction_closing_time': 1774716210.0, 'created_time': 1774553140.540706, 'last_price_update_time': 1774676152.536484}
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB15265') HTTP/1.1" 204 0
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-28 05:35:52 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-28 05:35:52 [auto1.de] INFO: Scrape type for RC23376: 2
2026-03-28 05:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-28 05:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with scrape type 2
2026-03-28 05:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04e9276b-2a63-5e8a-b776-b69d3245a5a3, identifier: RC23376
2026-03-28 05:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-28 05:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-28 05:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376 to the API
2026-03-28 05:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:59:49Z',
 'fuel_type': 'petrol',
 'id': '04e9276b-2a63-5e8a-b776-b69d3245a5a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC23376',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 96475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-26',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Saving data for RC23376: {'auction_closing_time': 1774717189.0, 'created_time': 1774552898.706366, 'last_price_update_time': 1774676153.39003}
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC23376') HTTP/1.1" 204 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG57897%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for UG57897: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC12806%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for ZC12806: 0
2026-03-28 05:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:53 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for SM33942: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF99655%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for MF99655: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF20598%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for KF20598: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for CT69735: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for NR70794: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ80756%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for NZ80756: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG32034%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for SG32034: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for KZ13921: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC39269%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for FC39269: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21931%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for FW21931: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR53559%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for ZR53559: 0
2026-03-28 05:35:53 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-28 05:35:53 [auto1.de] INFO: Scrape type for YT11339: 2
2026-03-28 05:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-28 05:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae20eda-ede5-525a-a78b-a982512d59ba with scrape type 2
2026-03-28 05:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae20eda-ede5-525a-a78b-a982512d59ba with scrape type 2
2026-03-28 05:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aae20eda-ede5-525a-a78b-a982512d59ba, identifier: YT11339
2026-03-28 05:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-28 05:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-28 05:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339 to the API
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-28T16:01:31Z',
 'fuel_type': 'petrol',
 'id': 'aae20eda-ede5-525a-a78b-a982512d59ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT11339',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 50437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Saving data for YT11339: {'auction_closing_time': 1774713691.0, 'created_time': 1774553045.797867, 'last_price_update_time': 1774676154.270127}
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT11339') HTTP/1.1" 204 0
2026-03-28 05:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX72935%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for TX72935: 2
2026-03-28 05:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f24d070f-045e-5211-a4b4-7d3e7352f2c0 with identifier: TX72935
2026-03-28 05:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24d070f-045e-5211-a4b4-7d3e7352f2c0 with scrape type 2
2026-03-28 05:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f24d070f-045e-5211-a4b4-7d3e7352f2c0 with scrape type 2
2026-03-28 05:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f24d070f-045e-5211-a4b4-7d3e7352f2c0, identifier: TX72935
2026-03-28 05:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f24d070f-045e-5211-a4b4-7d3e7352f2c0 with identifier: TX72935
2026-03-28 05:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f24d070f-045e-5211-a4b4-7d3e7352f2c0 with identifier: TX72935
2026-03-28 05:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f24d070f-045e-5211-a4b4-7d3e7352f2c0 with identifier: TX72935 to the API
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:34:41Z',
 'fuel_type': 'petrol',
 'id': 'f24d070f-045e-5211-a4b4-7d3e7352f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX72935',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 64961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX72935%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Saving data for TX72935: {'auction_closing_time': 1774715681.0, 'created_time': 1774552667.65173, 'last_price_update_time': 1774676154.821521}
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX72935') HTTP/1.1" 204 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: UM61936
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM61936%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for UM61936: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: UG86555
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG86555%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for UG86555: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV41644%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for XV41644: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA57032%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for NA57032: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for XJ33844: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50267%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for SK50267: 0
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-28 05:35:54 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-28 05:35:54 [auto1.de] INFO: Scrape type for TZ90006: 2
2026-03-28 05:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-28 05:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185ffc02-6dc3-5c85-a1fa-9be670beff36 with scrape type 2
2026-03-28 05:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 185ffc02-6dc3-5c85-a1fa-9be670beff36 with scrape type 2
2026-03-28 05:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 185ffc02-6dc3-5c85-a1fa-9be670beff36, identifier: TZ90006
2026-03-28 05:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-28 05:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-28 05:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006 to the API
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:33:57Z',
 'fuel_type': 'petrol',
 'id': '185ffc02-6dc3-5c85-a1fa-9be670beff36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ90006',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 38459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-06',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2023}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-28 05:35:55 [auto1.de] INFO: Saving data for TZ90006: {'auction_closing_time': 1774715637.0, 'created_time': 1774552928.058074, 'last_price_update_time': 1774676155.364431}
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ90006') HTTP/1.1" 204 0
2026-03-28 05:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:35:56 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9199 | hits on page: 40
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE29693%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for TE29693: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for UL75790: 2
2026-03-28 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a382216a-a92b-52a6-95ea-b22fca8d23ae with identifier: UL75790
2026-03-28 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a382216a-a92b-52a6-95ea-b22fca8d23ae with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a382216a-a92b-52a6-95ea-b22fca8d23ae with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a382216a-a92b-52a6-95ea-b22fca8d23ae, identifier: UL75790
2026-03-28 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a382216a-a92b-52a6-95ea-b22fca8d23ae with identifier: UL75790
2026-03-28 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a382216a-a92b-52a6-95ea-b22fca8d23ae with identifier: UL75790
2026-03-28 05:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a382216a-a92b-52a6-95ea-b22fca8d23ae with identifier: UL75790 to the API
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:53Z',
 'fuel_type': 'diesel',
 'id': 'a382216a-a92b-52a6-95ea-b22fca8d23ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL75790',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 154736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-10',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2020}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Saving data for UL75790: {'auction_closing_time': 1774716713.0, 'created_time': 1774553006.002705, 'last_price_update_time': 1774676156.779557}
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL75790') HTTP/1.1" 204 0
2026-03-28 05:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: NE03141
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE03141%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for NE03141: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH49236%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for CH49236: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV49639%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for SV49639: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for RB67874: 0
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 05:35:56 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-28 05:35:56 [auto1.de] INFO: Scrape type for BD68188: 2
2026-03-28 05:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-28 05:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db49fcff-ef2c-5e21-997c-439f6711ea39 with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db49fcff-ef2c-5e21-997c-439f6711ea39 with scrape type 2
2026-03-28 05:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db49fcff-ef2c-5e21-997c-439f6711ea39, identifier: BD68188
2026-03-28 05:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-28 05:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-28 05:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188 to the API
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:51Z',
 'fuel_type': 'petrol',
 'id': 'db49fcff-ef2c-5e21-997c-439f6711ea39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD68188',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 60221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-16',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Saving data for BD68188: {'auction_closing_time': 1774717131.0, 'created_time': 1774550754.954602, 'last_price_update_time': 1774676157.289629}
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD68188') HTTP/1.1" 204 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS52546%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for XS52546: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for EN21542: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA30458%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for MA30458: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF22574%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for XF22574: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for ZR39968: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53358%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for CP53358: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for HG88240: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ97695%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for YJ97695: 0
2026-03-28 05:35:57 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Scrape type for EW02544: 2
2026-03-28 05:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-28 05:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4398e8-dee8-55ff-acd2-2548d02a7cfa with scrape type 2
2026-03-28 05:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4398e8-dee8-55ff-acd2-2548d02a7cfa with scrape type 2
2026-03-28 05:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4398e8-dee8-55ff-acd2-2548d02a7cfa, identifier: EW02544
2026-03-28 05:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-28 05:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-28 05:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544 to the API
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:56Z',
 'fuel_type': 'petrol',
 'id': 'eb4398e8-dee8-55ff-acd2-2548d02a7cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW02544',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 134200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2015}
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-28 05:35:57 [auto1.de] INFO: Saving data for EW02544: {'auction_closing_time': 1774713956.0, 'created_time': 1774553089.639965, 'last_price_update_time': 1774676157.996713}
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW02544') HTTP/1.1" 204 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for HW68760: 2
2026-03-28 05:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-28 05:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6159ce-5606-5fe4-abc0-68ab1539d399 with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6159ce-5606-5fe4-abc0-68ab1539d399 with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6159ce-5606-5fe4-abc0-68ab1539d399, identifier: HW68760
2026-03-28 05:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-28 05:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-28 05:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760 to the API
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:06Z',
 'fuel_type': 'petrol',
 'id': 'bc6159ce-5606-5fe4-abc0-68ab1539d399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW68760',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 97553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Saving data for HW68760: {'auction_closing_time': 1774714446.0, 'created_time': 1774552801.673328, 'last_price_update_time': 1774676158.540451}
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW68760') HTTP/1.1" 204 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for AN41414: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF35020%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for KF35020: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09282%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for EU09282: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for KA83953: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX72797%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for PX72797: 0
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-28 05:35:58 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-28 05:35:58 [auto1.de] INFO: Scrape type for SA80165: 2
2026-03-28 05:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with identifier: SA80165
2026-03-28 05:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with scrape type 2
2026-03-28 05:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5, identifier: SA80165
2026-03-28 05:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with identifier: SA80165
2026-03-28 05:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with identifier: SA80165
2026-03-28 05:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5 with identifier: SA80165 to the API
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:57:11Z',
 'fuel_type': 'petrol',
 'id': '9dfd6ce4-8091-5cc8-a1c6-c1183ee65ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA80165',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Pajero',
 'odometer': 144700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-03-16',
 'seller_name': None,
 'title': 'Mitsubishi Pajero 1.8 GDI Comfort II 1800',
 'transmission': 'automatic',
 'trim': 'Comfort II 1800',
 'year': 2000}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Saving data for SA80165: {'auction_closing_time': 1774717031.0, 'created_time': 1774552843.315693, 'last_price_update_time': 1774676159.074531}
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA80165') HTTP/1.1" 204 0
2026-03-28 05:35:59 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB81090%27 HTTP/1.1" 200 None
2026-03-28 05:35:59 [auto1.de] INFO: Scrape type for PB81090: 0
2026-03-28 05:35:59 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-28 05:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:00 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: FH28762
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH28762%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for FH28762: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01994%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for LC01994: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92284%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for PB92284: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53073%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for GC53073: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for BZ91725: 2
2026-03-28 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-28 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5660d15-35f0-55b5-8062-ca56a20343a7 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5660d15-35f0-55b5-8062-ca56a20343a7 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5660d15-35f0-55b5-8062-ca56a20343a7, identifier: BZ91725
2026-03-28 05:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-28 05:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-28 05:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725 to the API
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:49Z',
 'fuel_type': 'petrol',
 'id': 'f5660d15-35f0-55b5-8062-ca56a20343a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ91725',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 206335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-06-28',
 'seller_name': None,
 'title': 'Saab 9-5 2.0 T Ecopower',
 'transmission': 'manual',
 'trim': 'T Ecopower',
 'year': 1999}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Saving data for BZ91725: {'auction_closing_time': 1774716349.0, 'created_time': 1773228855.651318, 'last_price_update_time': 1774676160.613269}
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ91725') HTTP/1.1" 204 0
2026-03-28 05:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for WR98876: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ10091%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for GZ10091: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY36378%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for KY36378: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS62800%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for CS62800: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for JG35901: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for BB98508: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL65001%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for AL65001: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for RM44288: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62176%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for UT62176: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE76243%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for VE76243: 0
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-28 05:36:00 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-28 05:36:00 [auto1.de] INFO: Scrape type for RJ18784: 2
2026-03-28 05:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-28 05:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with scrape type 2
2026-03-28 05:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with scrape type 2
2026-03-28 05:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9, identifier: RJ18784
2026-03-28 05:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-28 05:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-28 05:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784 to the API
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-28T16:16:53Z',
 'fuel_type': 'petrol',
 'id': '06f2b599-c4ba-547b-bbe4-b73f25e7c0c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ18784',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 26077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 4WD',
 'transmission': 'automatic',
 'trim': 'Trend 4WD',
 'year': 2023}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-28 05:36:01 [auto1.de] INFO: Saving data for RJ18784: {'auction_closing_time': 1774714613.0, 'created_time': 1774552802.270755, 'last_price_update_time': 1774676161.344623}
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ18784') HTTP/1.1" 204 0
2026-03-28 05:36:01 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 05:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:02 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT59975%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for RT59975: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for MY48051: 0
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for SP90277: 2
2026-03-28 05:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-28 05:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with scrape type 2
2026-03-28 05:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with scrape type 2
2026-03-28 05:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885, identifier: SP90277
2026-03-28 05:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-28 05:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-28 05:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277 to the API
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:18:02Z',
 'fuel_type': 'diesel',
 'id': '80fb2d25-921b-57f0-ac56-1c9aa6dfa885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP90277',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 322220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-12',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Saving data for SP90277: {'auction_closing_time': 1774714682.0, 'created_time': 1774553185.060257, 'last_price_update_time': 1774676162.876638}
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP90277') HTTP/1.1" 204 0
2026-03-28 05:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 05:36:02 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-28 05:36:02 [auto1.de] INFO: Scrape type for UA59883: 2
2026-03-28 05:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ded798b-4daa-5c65-b552-fb3f5346298d with identifier: UA59883
2026-03-28 05:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ded798b-4daa-5c65-b552-fb3f5346298d with scrape type 2
2026-03-28 05:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ded798b-4daa-5c65-b552-fb3f5346298d with scrape type 2
2026-03-28 05:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ded798b-4daa-5c65-b552-fb3f5346298d, identifier: UA59883
2026-03-28 05:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ded798b-4daa-5c65-b552-fb3f5346298d with identifier: UA59883
2026-03-28 05:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ded798b-4daa-5c65-b552-fb3f5346298d with identifier: UA59883
2026-03-28 05:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ded798b-4daa-5c65-b552-fb3f5346298d with identifier: UA59883 to the API
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:38:13Z',
 'fuel_type': 'petrol',
 'id': '9ded798b-4daa-5c65-b552-fb3f5346298d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA59883',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 9546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-25',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2024}
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Saving data for UA59883: {'auction_closing_time': 1774715893.0, 'created_time': 1774552988.356556, 'last_price_update_time': 1774676163.313137}
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA59883') HTTP/1.1" 204 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP27281%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for PP27281: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for XP68837: 2
2026-03-28 05:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-28 05:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with scrape type 2
2026-03-28 05:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with scrape type 2
2026-03-28 05:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1, identifier: XP68837
2026-03-28 05:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-28 05:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-28 05:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837 to the API
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:17:05Z',
 'fuel_type': 'diesel',
 'id': '2fe13f3e-934d-5adc-88e0-9add93d8d2f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP68837',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 113780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2018}
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Saving data for XP68837: {'auction_closing_time': 1774714625.0, 'created_time': 1774551859.747393, 'last_price_update_time': 1774676163.869612}
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP68837') HTTP/1.1" 204 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for NY57954: 0
2026-03-28 05:36:03 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-28 05:36:03 [auto1.de] INFO: Scrape type for SN40806: 2
2026-03-28 05:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-28 05:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b227d964-7050-585d-8aa9-d88ee45e6971 with scrape type 2
2026-03-28 05:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b227d964-7050-585d-8aa9-d88ee45e6971 with scrape type 2
2026-03-28 05:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b227d964-7050-585d-8aa9-d88ee45e6971, identifier: SN40806
2026-03-28 05:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-28 05:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-28 05:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806 to the API
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:33:24Z',
 'fuel_type': 'petrol',
 'id': 'b227d964-7050-585d-8aa9-d88ee45e6971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN40806',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 206890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-19',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Saving data for SN40806: {'auction_closing_time': 1774715604.0, 'created_time': 1774589755.699264, 'last_price_update_time': 1774676164.385441}
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN40806') HTTP/1.1" 204 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN02057%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for UN02057: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for JK52723: 2
2026-03-28 05:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-28 05:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a464ab33-d1b2-5857-9311-42fccdbf3cb9 with scrape type 2
2026-03-28 05:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a464ab33-d1b2-5857-9311-42fccdbf3cb9 with scrape type 2
2026-03-28 05:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a464ab33-d1b2-5857-9311-42fccdbf3cb9, identifier: JK52723
2026-03-28 05:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-28 05:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-28 05:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723 to the API
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:05:18Z',
 'fuel_type': 'petrol',
 'id': 'a464ab33-d1b2-5857-9311-42fccdbf3cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK52723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 67869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Saving data for JK52723: {'auction_closing_time': 1774713918.0, 'created_time': 1773306603.499724, 'last_price_update_time': 1774676164.857284}
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK52723') HTTP/1.1" 204 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for VR87804: 0
2026-03-28 05:36:04 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-28 05:36:04 [auto1.de] INFO: Scrape type for KG80613: 2
2026-03-28 05:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-28 05:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with scrape type 2
2026-03-28 05:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4, identifier: KG80613
2026-03-28 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-28 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-28 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613 to the API
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:07:13Z',
 'fuel_type': 'diesel',
 'id': '2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG80613',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 130421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'BMW 5er M550d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2017}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Saving data for KG80613: {'auction_closing_time': 1774714033.0, 'created_time': 1773343060.79328, 'last_price_update_time': 1774676165.342094}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG80613') HTTP/1.1" 204 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG37465%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for LG37465: 0
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 05:36:05 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Scrape type for KN98252: 2
2026-03-28 05:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-28 05:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569beffa-e0c9-5d56-9dd4-38730caefcf9 with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569beffa-e0c9-5d56-9dd4-38730caefcf9 with scrape type 2
2026-03-28 05:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 569beffa-e0c9-5d56-9dd4-38730caefcf9, identifier: KN98252
2026-03-28 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 05:36:05 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-28 05:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252 to the API
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'petrol',
 'id': '569beffa-e0c9-5d56-9dd4-38730caefcf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN98252',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 160984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition 2000',
 'transmission': 'automatic',
 'trim': 'Edition 2000',
 'year': 2000}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-28 05:36:05 [auto1.de] INFO: Saving data for KN98252: {'auction_closing_time': 1774714788.0, 'created_time': 1774553235.109407, 'last_price_update_time': 1774676165.93557}
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN98252') HTTP/1.1" 204 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for DN02562: 2
2026-03-28 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-28 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278739f2-90c6-54af-93fb-a5d4aa2d3edc with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 278739f2-90c6-54af-93fb-a5d4aa2d3edc with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 278739f2-90c6-54af-93fb-a5d4aa2d3edc, identifier: DN02562
2026-03-28 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-28 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-28 05:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562 to the API
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:34:53Z',
 'fuel_type': 'diesel',
 'id': '278739f2-90c6-54af-93fb-a5d4aa2d3edc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN02562',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2022}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Saving data for DN02562: {'auction_closing_time': 1774715693.0, 'created_time': 1774553016.160187, 'last_price_update_time': 1774676166.482595}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN02562') HTTP/1.1" 204 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99393%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for PM99393: 2
2026-03-28 05:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33094660-567a-57f0-8e7c-e1acbf971d62 with identifier: PM99393
2026-03-28 05:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33094660-567a-57f0-8e7c-e1acbf971d62 with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33094660-567a-57f0-8e7c-e1acbf971d62 with scrape type 2
2026-03-28 05:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33094660-567a-57f0-8e7c-e1acbf971d62, identifier: PM99393
2026-03-28 05:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:06 [scrapy.extensions.logstats] INFO: Crawled 47 pages (at 47 pages/min), scraped 53 items (at 53 items/min)
2026-03-28 05:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33094660-567a-57f0-8e7c-e1acbf971d62 with identifier: PM99393
2026-03-28 05:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33094660-567a-57f0-8e7c-e1acbf971d62 with identifier: PM99393
2026-03-28 05:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33094660-567a-57f0-8e7c-e1acbf971d62 with identifier: PM99393 to the API
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:58Z',
 'fuel_type': 'diesel',
 'id': '33094660-567a-57f0-8e7c-e1acbf971d62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM99393',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 104567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Audi A4 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99393%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Saving data for PM99393: {'auction_closing_time': 1774715098.0, 'created_time': 1773307524.142305, 'last_price_update_time': 1774676166.898384}
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PM99393') HTTP/1.1" 204 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for KV84716: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP65062%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for PP65062: 0
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM25194%27 HTTP/1.1" 200 None
2026-03-28 05:36:06 [auto1.de] INFO: Scrape type for KM25194: 0
2026-03-28 05:36:06 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:06 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-28 05:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Scrape type for JD41613: 2
2026-03-28 05:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-28 05:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with scrape type 2
2026-03-28 05:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with scrape type 2
2026-03-28 05:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cc71a9c-6856-5754-93e6-86a2b49f5c49, identifier: JD41613
2026-03-28 05:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-28 05:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-28 05:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613 to the API
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:11:52Z',
 'fuel_type': 'diesel',
 'id': '9cc71a9c-6856-5754-93e6-86a2b49f5c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD41613',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 233894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Saving data for JD41613: {'auction_closing_time': 1774714312.0, 'created_time': 1773228716.847241, 'last_price_update_time': 1774676167.435572}
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD41613') HTTP/1.1" 204 0
2026-03-28 05:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:07 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-28 05:36:07 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV91095%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Scrape type for LV91095: 0
2026-03-28 05:36:07 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 05:36:07 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF34298%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Scrape type for PF34298: 0
2026-03-28 05:36:07 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-28 05:36:07 [auto1.de] INFO: Scrape type for GE40777: 2
2026-03-28 05:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-28 05:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with scrape type 2
2026-03-28 05:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with scrape type 2
2026-03-28 05:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6c276f8-e681-5bee-bd4c-cd492c15cfa3, identifier: GE40777
2026-03-28 05:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-28 05:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-28 05:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777 to the API
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:06:02Z',
 'fuel_type': 'petrol',
 'id': 'b6c276f8-e681-5bee-bd4c-cd492c15cfa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE40777',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 145731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2016}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Saving data for GE40777: {'auction_closing_time': 1774713962.0, 'created_time': 1773341449.229302, 'last_price_update_time': 1774676168.045185}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE40777') HTTP/1.1" 204 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for DY72609: 2
2026-03-28 05:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e908b67d-bb02-5f25-9252-3016a40aacc0 with identifier: DY72609
2026-03-28 05:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e908b67d-bb02-5f25-9252-3016a40aacc0 with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e908b67d-bb02-5f25-9252-3016a40aacc0 with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e908b67d-bb02-5f25-9252-3016a40aacc0, identifier: DY72609
2026-03-28 05:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e908b67d-bb02-5f25-9252-3016a40aacc0 with identifier: DY72609
2026-03-28 05:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e908b67d-bb02-5f25-9252-3016a40aacc0 with identifier: DY72609
2026-03-28 05:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e908b67d-bb02-5f25-9252-3016a40aacc0 with identifier: DY72609 to the API
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:38:01Z',
 'fuel_type': 'petrol',
 'id': 'e908b67d-bb02-5f25-9252-3016a40aacc0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY72609',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 194747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-28',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 More',
 'transmission': 'manual',
 'trim': 'More',
 'year': 2008}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Saving data for DY72609: {'auction_closing_time': 1774715881.0, 'created_time': 1774552828.472954, 'last_price_update_time': 1774676168.481982}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY72609') HTTP/1.1" 204 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG55505%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for UG55505: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for LL99453: 2
2026-03-28 05:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-28 05:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466fb675-e6d3-57a6-adf1-bfc280942a1a with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466fb675-e6d3-57a6-adf1-bfc280942a1a with scrape type 2
2026-03-28 05:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466fb675-e6d3-57a6-adf1-bfc280942a1a, identifier: LL99453
2026-03-28 05:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-28 05:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-28 05:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453 to the API
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:32:25Z',
 'fuel_type': 'petrol',
 'id': '466fb675-e6d3-57a6-adf1-bfc280942a1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL99453',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 188084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2011}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Saving data for LL99453: {'auction_closing_time': 1774715545.0, 'created_time': 1774553222.722959, 'last_price_update_time': 1774676168.939558}
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL99453') HTTP/1.1" 204 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD08227%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for SD08227: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-28 05:36:08 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-28 05:36:08 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH28050%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for YH28050: 2
2026-03-28 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bf00849-a471-5f1f-a457-7685dd1b4a2f with identifier: YH28050
2026-03-28 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bf00849-a471-5f1f-a457-7685dd1b4a2f with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bf00849-a471-5f1f-a457-7685dd1b4a2f with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bf00849-a471-5f1f-a457-7685dd1b4a2f, identifier: YH28050
2026-03-28 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bf00849-a471-5f1f-a457-7685dd1b4a2f with identifier: YH28050
2026-03-28 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bf00849-a471-5f1f-a457-7685dd1b4a2f with identifier: YH28050
2026-03-28 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bf00849-a471-5f1f-a457-7685dd1b4a2f with identifier: YH28050 to the API
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:51:52Z',
 'fuel_type': 'petrol',
 'id': '3bf00849-a471-5f1f-a457-7685dd1b4a2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH28050',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 159025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH28050%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Saving data for YH28050: {'auction_closing_time': 1774716712.0, 'created_time': 1774552882.89483, 'last_price_update_time': 1774676169.446178}
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH28050') HTTP/1.1" 204 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE18812%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for EE18812: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for NL93561: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for LX13795: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA47491%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for XA47491: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79977%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for KL79977: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-28 05:36:09 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-28 05:36:09 [auto1.de] INFO: Scrape type for XX63179: 2
2026-03-28 05:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with identifier: XX63179
2026-03-28 05:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with scrape type 2
2026-03-28 05:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54c21fc3-1e71-5fe1-823f-c1aa26a858a5, identifier: XX63179
2026-03-28 05:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with identifier: XX63179
2026-03-28 05:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with identifier: XX63179
2026-03-28 05:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54c21fc3-1e71-5fe1-823f-c1aa26a858a5 with identifier: XX63179 to the API
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:46:25Z',
 'fuel_type': 'diesel',
 'id': '54c21fc3-1e71-5fe1-823f-c1aa26a858a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX63179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 102817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Saving data for XX63179: {'auction_closing_time': 1774716385.0, 'created_time': 1773946779.937047, 'last_price_update_time': 1774676170.101424}
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX63179') HTTP/1.1" 204 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ74621%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for YJ74621: 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY04556%27 HTTP/1.1" 200 None
2026-03-28 05:36:10 [auto1.de] INFO: Scrape type for XY04556: 0
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-28 05:36:10 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-28 05:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:11 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for JX09791: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE28324%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for KE28324: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for SW57264: 2
2026-03-28 05:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4207308-eb89-56a6-8049-612ce59405bd with identifier: SW57264
2026-03-28 05:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4207308-eb89-56a6-8049-612ce59405bd with scrape type 2
2026-03-28 05:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4207308-eb89-56a6-8049-612ce59405bd with scrape type 2
2026-03-28 05:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4207308-eb89-56a6-8049-612ce59405bd, identifier: SW57264
2026-03-28 05:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4207308-eb89-56a6-8049-612ce59405bd with identifier: SW57264
2026-03-28 05:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4207308-eb89-56a6-8049-612ce59405bd with identifier: SW57264
2026-03-28 05:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4207308-eb89-56a6-8049-612ce59405bd with identifier: SW57264 to the API
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:49:26Z',
 'fuel_type': 'petrol',
 'id': 'c4207308-eb89-56a6-8049-612ce59405bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW57264',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 37,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-25',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2024}
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Saving data for SW57264: {'auction_closing_time': 1774716566.0, 'created_time': 1774550347.979355, 'last_price_update_time': 1774676171.525877}
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW57264') HTTP/1.1" 204 0
2026-03-28 05:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC60331%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for WC60331: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP53621%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for WP53621: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80986%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for UP80986: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12471%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for YT12471: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ67578%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for UJ67578: 0
2026-03-28 05:36:11 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-28 05:36:11 [auto1.de] INFO: Scrape type for XP92221: 2
2026-03-28 05:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-28 05:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with scrape type 2
2026-03-28 05:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with scrape type 2
2026-03-28 05:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17ddd9b0-3008-5777-aab4-758d0fc42bf6, identifier: XP92221
2026-03-28 05:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-28 05:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-28 05:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221 to the API
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'petrol',
 'id': '17ddd9b0-3008-5777-aab4-758d0fc42bf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP92221',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 130825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2009}
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Saving data for XP92221: {'auction_closing_time': 1774713810.0, 'created_time': 1774589752.960207, 'last_price_update_time': 1774676172.048738}
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP92221') HTTP/1.1" 204 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for LN92590: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for UY72197: 2
2026-03-28 05:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with identifier: UY72197
2026-03-28 05:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with scrape type 2
2026-03-28 05:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with scrape type 2
2026-03-28 05:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3, identifier: UY72197
2026-03-28 05:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with identifier: UY72197
2026-03-28 05:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with identifier: UY72197
2026-03-28 05:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3 with identifier: UY72197 to the API
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'petrol',
 'id': '76f4d3c4-d3c3-5219-a7ae-6fe4ab33b6a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY72197',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 179213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-12',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition ecoFlex 4x4',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex 4x4',
 'year': 2015}
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Saving data for UY72197: {'auction_closing_time': 1774716963.0, 'created_time': 1774550624.889868, 'last_price_update_time': 1774676172.629898}
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY72197') HTTP/1.1" 204 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14776%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for BY14776: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG40376%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for FG40376: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for LU76842: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF25786%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for DF25786: 0
2026-03-28 05:36:12 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL14403%27 HTTP/1.1" 200 None
2026-03-28 05:36:12 [auto1.de] INFO: Scrape type for RL14403: 2
2026-03-28 05:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c158a6-cbb3-51b8-8d68-86cb23459fcd with identifier: RL14403
2026-03-28 05:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c158a6-cbb3-51b8-8d68-86cb23459fcd with scrape type 2
2026-03-28 05:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37c158a6-cbb3-51b8-8d68-86cb23459fcd with scrape type 2
2026-03-28 05:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37c158a6-cbb3-51b8-8d68-86cb23459fcd, identifier: RL14403
2026-03-28 05:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37c158a6-cbb3-51b8-8d68-86cb23459fcd with identifier: RL14403
2026-03-28 05:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37c158a6-cbb3-51b8-8d68-86cb23459fcd with identifier: RL14403
2026-03-28 05:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37c158a6-cbb3-51b8-8d68-86cb23459fcd with identifier: RL14403 to the API
2026-03-28 05:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:59:20Z',
 'fuel_type': 'petrol',
 'id': '37c158a6-cbb3-51b8-8d68-86cb23459fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL14403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 72368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-05',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL14403%27 HTTP/1.1" 200 None
2026-03-28 05:36:13 [auto1.de] INFO: Saving data for RL14403: {'auction_closing_time': 1774717160.0, 'created_time': 1774464094.427116, 'last_price_update_time': 1774676173.1418}
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL14403') HTTP/1.1" 204 0
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-28 05:36:13 [auto1.de] INFO: Scrape type for CP27370: 2
2026-03-28 05:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-28 05:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e2ebf7-346a-53eb-90bd-99f8528d9613 with scrape type 2
2026-03-28 05:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e2ebf7-346a-53eb-90bd-99f8528d9613 with scrape type 2
2026-03-28 05:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e2ebf7-346a-53eb-90bd-99f8528d9613, identifier: CP27370
2026-03-28 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-28 05:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370 to the API
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:13:30Z',
 'fuel_type': 'diesel',
 'id': '93e2ebf7-346a-53eb-90bd-99f8528d9613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP27370',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 237203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-28 05:36:13 [auto1.de] INFO: Saving data for CP27370: {'auction_closing_time': 1774714410.0, 'created_time': 1773382785.206724, 'last_price_update_time': 1774676173.830417}
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP27370') HTTP/1.1" 204 0
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM29679%27 HTTP/1.1" 200 None
2026-03-28 05:36:13 [auto1.de] INFO: Scrape type for VM29679: 0
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-28 05:36:13 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-28 05:36:13 [auto1.de] INFO: Scrape type for MA12811: 2
2026-03-28 05:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-28 05:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000e75a5-31cd-567a-bc25-60f261728f58 with scrape type 2
2026-03-28 05:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 000e75a5-31cd-567a-bc25-60f261728f58 with scrape type 2
2026-03-28 05:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 000e75a5-31cd-567a-bc25-60f261728f58, identifier: MA12811
2026-03-28 05:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-28 05:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-28 05:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811 to the API
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:08:50Z',
 'fuel_type': 'petrol',
 'id': '000e75a5-31cd-567a-bc25-60f261728f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA12811',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 227130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-28 05:36:14 [auto1.de] INFO: Saving data for MA12811: {'auction_closing_time': 1774714130.0, 'created_time': 1774553147.263632, 'last_price_update_time': 1774676174.290557}
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA12811') HTTP/1.1" 204 0
2026-03-28 05:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:15 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: YV00461
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV00461%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for YV00461: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR52929%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for WR52929: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76329%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for UM76329: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC21534%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for VC21534: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM07244%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for CM07244: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT76728%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for FT76728: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES78783%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for ES78783: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for ZY80626: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ29379%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for SZ29379: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG57844%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for JG57844: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR65399%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for WR65399: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ83876%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for MJ83876: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: DX81242
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03650%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for MF03650: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69503%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for DE69503: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE45637%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for SE45637: 0
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW35231%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Scrape type for CW35231: 2
2026-03-28 05:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d93301cc-78e5-5134-8c8a-611c8c7b93b8 with identifier: CW35231
2026-03-28 05:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d93301cc-78e5-5134-8c8a-611c8c7b93b8 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d93301cc-78e5-5134-8c8a-611c8c7b93b8 with scrape type 2
2026-03-28 05:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d93301cc-78e5-5134-8c8a-611c8c7b93b8, identifier: CW35231
2026-03-28 05:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d93301cc-78e5-5134-8c8a-611c8c7b93b8 with identifier: CW35231
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 05:36:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d93301cc-78e5-5134-8c8a-611c8c7b93b8 with identifier: CW35231
2026-03-28 05:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d93301cc-78e5-5134-8c8a-611c8c7b93b8 with identifier: CW35231 to the API
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:17:01Z',
 'fuel_type': 'petrol',
 'id': 'd93301cc-78e5-5134-8c8a-611c8c7b93b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW35231',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 211146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-23',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW35231%27 HTTP/1.1" 200 None
2026-03-28 05:36:15 [auto1.de] INFO: Saving data for CW35231: {'auction_closing_time': 1774714621.0, 'created_time': 1774463876.083502, 'last_price_update_time': 1774676175.874795}
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW35231') HTTP/1.1" 204 0
2026-03-28 05:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:15 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 05:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for JP43917: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT80766%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for UT80766: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP12786%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for MP12786: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA53965%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for BA53965: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM06383%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for BM06383: 2
2026-03-28 05:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with identifier: BM06383
2026-03-28 05:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f9e8bc3-682f-5404-af10-1e920d2fb0a9, identifier: BM06383
2026-03-28 05:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with identifier: BM06383
2026-03-28 05:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with identifier: BM06383
2026-03-28 05:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f9e8bc3-682f-5404-af10-1e920d2fb0a9 with identifier: BM06383 to the API
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:07:49Z',
 'fuel_type': 'diesel',
 'id': '0f9e8bc3-682f-5404-af10-1e920d2fb0a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM06383',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 246191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-30',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM06383%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Saving data for BM06383: {'auction_closing_time': 1774714069.0, 'created_time': 1774463886.10467, 'last_price_update_time': 1774676176.486342}
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM06383') HTTP/1.1" 204 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53582%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for XL53582: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA45757%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for VA45757: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH52741%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for DH52741: 0
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: AL76969
2026-03-28 05:36:16 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS93174%27 HTTP/1.1" 200 None
2026-03-28 05:36:16 [auto1.de] INFO: Scrape type for LS93174: 2
2026-03-28 05:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606bbaad-bf64-58b8-9847-f4649007ba77 with identifier: LS93174
2026-03-28 05:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606bbaad-bf64-58b8-9847-f4649007ba77 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606bbaad-bf64-58b8-9847-f4649007ba77 with scrape type 2
2026-03-28 05:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606bbaad-bf64-58b8-9847-f4649007ba77, identifier: LS93174
2026-03-28 05:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606bbaad-bf64-58b8-9847-f4649007ba77 with identifier: LS93174
2026-03-28 05:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606bbaad-bf64-58b8-9847-f4649007ba77 with identifier: LS93174
2026-03-28 05:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606bbaad-bf64-58b8-9847-f4649007ba77 with identifier: LS93174 to the API
2026-03-28 05:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:42:33Z',
 'fuel_type': 'petrol',
 'id': '606bbaad-bf64-58b8-9847-f4649007ba77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS93174',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Impreza',
 'odometer': 92036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Subaru Impreza 1.6 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS93174%27 HTTP/1.1" 200 None
2026-03-28 05:36:17 [auto1.de] INFO: Saving data for LS93174: {'auction_closing_time': 1774716153.0, 'created_time': 1772544249.327589, 'last_price_update_time': 1774676177.899862}
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS93174') HTTP/1.1" 204 0
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM55631%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for UM55631: 0
2026-03-28 05:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:18 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:18 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-28 05:36:18 [auto1.de] INFO: Scrape type for BG43270: 2
2026-03-28 05:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34c553cb-47d6-58fb-9885-36220c393cfc with identifier: BG43270
2026-03-28 05:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34c553cb-47d6-58fb-9885-36220c393cfc with scrape type 2
2026-03-28 05:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34c553cb-47d6-58fb-9885-36220c393cfc with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34c553cb-47d6-58fb-9885-36220c393cfc, identifier: BG43270
2026-03-28 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34c553cb-47d6-58fb-9885-36220c393cfc with identifier: BG43270
2026-03-28 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34c553cb-47d6-58fb-9885-36220c393cfc with identifier: BG43270
2026-03-28 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34c553cb-47d6-58fb-9885-36220c393cfc with identifier: BG43270 to the API
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:52Z',
 'fuel_type': 'diesel',
 'id': '34c553cb-47d6-58fb-9885-36220c393cfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG43270',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 23765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-28',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Saving data for BG43270: {'auction_closing_time': 1774715272.0, 'created_time': 1774552714.348319, 'last_price_update_time': 1774676179.389678}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG43270') HTTP/1.1" 204 0
2026-03-28 05:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: US98158
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for SE09507: 2
2026-03-28 05:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-28 05:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ab2b08-9c63-54fa-a0ab-f5628df18c08, identifier: SE09507
2026-03-28 05:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-28 05:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-28 05:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507 to the API
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-28T16:13:34Z',
 'fuel_type': 'petrol',
 'id': '14ab2b08-9c63-54fa-a0ab-f5628df18c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE09507',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 106053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-31',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 1999}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Saving data for SE09507: {'auction_closing_time': 1774714414.0, 'created_time': 1774552913.72616, 'last_price_update_time': 1774676179.842034}
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE09507') HTTP/1.1" 204 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ97961%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for XZ97961: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ98687%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for AZ98687: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10962%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for SP10962: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL48053%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for DL48053: 0
2026-03-28 05:36:19 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16408%27 HTTP/1.1" 200 None
2026-03-28 05:36:19 [auto1.de] INFO: Scrape type for MH16408: 2
2026-03-28 05:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with identifier: MH16408
2026-03-28 05:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with scrape type 2
2026-03-28 05:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with scrape type 2
2026-03-28 05:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a, identifier: MH16408
2026-03-28 05:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with identifier: MH16408
2026-03-28 05:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with identifier: MH16408
2026-03-28 05:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18550812-28ec-58ba-a3f3-f3f4b7e6ce7a with identifier: MH16408 to the API
2026-03-28 05:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:11Z',
 'fuel_type': 'petrol',
 'id': '18550812-28ec-58ba-a3f3-f3f4b7e6ce7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH16408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 27363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16408%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Saving data for MH16408: {'auction_closing_time': 1774715531.0, 'created_time': 1773916754.64011, 'last_price_update_time': 1774676181.375482}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH16408') HTTP/1.1" 204 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43121%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for XW43121: 2
2026-03-28 05:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9da1e68f-019a-5680-8c97-a29f9abec765 with identifier: XW43121
2026-03-28 05:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9da1e68f-019a-5680-8c97-a29f9abec765 with scrape type 2
2026-03-28 05:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9da1e68f-019a-5680-8c97-a29f9abec765 with scrape type 2
2026-03-28 05:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9da1e68f-019a-5680-8c97-a29f9abec765, identifier: XW43121
2026-03-28 05:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9da1e68f-019a-5680-8c97-a29f9abec765 with identifier: XW43121
2026-03-28 05:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9da1e68f-019a-5680-8c97-a29f9abec765 with identifier: XW43121
2026-03-28 05:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9da1e68f-019a-5680-8c97-a29f9abec765 with identifier: XW43121 to the API
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:01:17Z',
 'fuel_type': 'diesel',
 'id': '9da1e68f-019a-5680-8c97-a29f9abec765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW43121',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 127505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-26',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2010}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43121%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Saving data for XW43121: {'auction_closing_time': 1774713677.0, 'created_time': 1774463934.522833, 'last_price_update_time': 1774676181.906459}
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW43121') HTTP/1.1" 204 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN08657%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for WN08657: 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ49334%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for WJ49334: 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX66529%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for CX66529: 0
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-28 05:36:21 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC85664%27 HTTP/1.1" 200 None
2026-03-28 05:36:21 [auto1.de] INFO: Scrape type for ZC85664: 2
2026-03-28 05:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9629ab6e-8aec-5118-a103-c7c5cad69d93 with identifier: ZC85664
2026-03-28 05:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9629ab6e-8aec-5118-a103-c7c5cad69d93 with scrape type 2
2026-03-28 05:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9629ab6e-8aec-5118-a103-c7c5cad69d93 with scrape type 2
2026-03-28 05:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9629ab6e-8aec-5118-a103-c7c5cad69d93, identifier: ZC85664
2026-03-28 05:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9629ab6e-8aec-5118-a103-c7c5cad69d93 with identifier: ZC85664
2026-03-28 05:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9629ab6e-8aec-5118-a103-c7c5cad69d93 with identifier: ZC85664
2026-03-28 05:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9629ab6e-8aec-5118-a103-c7c5cad69d93 with identifier: ZC85664 to the API
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:12:55Z',
 'fuel_type': 'diesel',
 'id': '9629ab6e-8aec-5118-a103-c7c5cad69d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC85664',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 38050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-26',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC85664%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Saving data for ZC85664: {'auction_closing_time': 1774714375.0, 'created_time': 1773380356.934111, 'last_price_update_time': 1774676182.464884}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC85664') HTTP/1.1" 204 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for DJ88162: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY78150%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for BY78150: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-28 05:36:22 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Scrape type for HK34206: 2
2026-03-28 05:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-28 05:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with scrape type 2
2026-03-28 05:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with scrape type 2
2026-03-28 05:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19, identifier: HK34206
2026-03-28 05:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-28 05:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-28 05:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206 to the API
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:23:05Z',
 'fuel_type': 'petrol',
 'id': '3d143d77-a736-5d72-b1d1-ae6a2a4c3f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK34206',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-12-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 1998}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-28 05:36:22 [auto1.de] INFO: Saving data for HK34206: {'auction_closing_time': 1774714985.0, 'created_time': 1774550625.237234, 'last_price_update_time': 1774676182.968199}
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK34206') HTTP/1.1" 204 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH17193%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for YH17193: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU83638%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for BU83638: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR39540%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for HR39540: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS35479%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for RS35479: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC43161%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for WC43161: 0
2026-03-28 05:36:23 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM50991%27 HTTP/1.1" 200 None
2026-03-28 05:36:23 [auto1.de] INFO: Scrape type for YM50991: 2
2026-03-28 05:36:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c17226-2d7d-5cc2-9d80-1a42b2657758 with identifier: YM50991
2026-03-28 05:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c17226-2d7d-5cc2-9d80-1a42b2657758 with scrape type 2
2026-03-28 05:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92c17226-2d7d-5cc2-9d80-1a42b2657758 with scrape type 2
2026-03-28 05:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92c17226-2d7d-5cc2-9d80-1a42b2657758, identifier: YM50991
2026-03-28 05:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92c17226-2d7d-5cc2-9d80-1a42b2657758 with identifier: YM50991
2026-03-28 05:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92c17226-2d7d-5cc2-9d80-1a42b2657758 with identifier: YM50991
2026-03-28 05:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92c17226-2d7d-5cc2-9d80-1a42b2657758 with identifier: YM50991 to the API
2026-03-28 05:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:57:32Z',
 'fuel_type': 'diesel',
 'id': '92c17226-2d7d-5cc2-9d80-1a42b2657758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM50991',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 306591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM50991%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Saving data for YM50991: {'auction_closing_time': 1774717052.0, 'created_time': 1772727941.044082, 'last_price_update_time': 1774676184.395437}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM50991') HTTP/1.1" 204 0
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Scrape type for TS98939: 2
2026-03-28 05:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-28 05:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with scrape type 2
2026-03-28 05:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with scrape type 2
2026-03-28 05:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41, identifier: TS98939
2026-03-28 05:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-28 05:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-28 05:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939 to the API
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:11:33Z',
 'fuel_type': 'petrol',
 'id': 'f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS98939',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 66467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up!',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2016}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-28 05:36:24 [auto1.de] INFO: Saving data for TS98939: {'auction_closing_time': 1774714293.0, 'created_time': 1773383195.315336, 'last_price_update_time': 1774676184.940081}
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS98939') HTTP/1.1" 204 0
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-28 05:36:24 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-28 05:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:25 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ37842%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for LZ37842: 2
2026-03-28 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with identifier: LZ37842
2026-03-28 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9, identifier: LZ37842
2026-03-28 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with identifier: LZ37842
2026-03-28 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with identifier: LZ37842
2026-03-28 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bd9b835-7cb4-54c9-8eb2-b2b05da196f9 with identifier: LZ37842 to the API
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:04Z',
 'fuel_type': 'diesel',
 'id': '2bd9b835-7cb4-54c9-8eb2-b2b05da196f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ37842',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 34740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-30',
 'seller_name': None,
 'title': 'Opel Movano 2.2 CDTI HKa L3H2 3,5t Edition',
 'transmission': 'manual',
 'trim': 'HKa L3H2 3,5t Edition',
 'year': 2024}
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ37842%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Saving data for LZ37842: {'auction_closing_time': 1774714564.0, 'created_time': 1774550349.081067, 'last_price_update_time': 1774676185.545875}
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ37842') HTTP/1.1" 204 0
2026-03-28 05:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for EV72489: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD10276%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for TD10276: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: TZ50604
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ50604%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for TZ50604: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for TS98691: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB13606%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for LB13606: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT93996%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for AT93996: 0
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-28 05:36:25 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-28 05:36:25 [auto1.de] INFO: Scrape type for PT15230: 2
2026-03-28 05:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-28 05:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55028ee-52c7-5b04-9d94-24b43e31d24b with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55028ee-52c7-5b04-9d94-24b43e31d24b with scrape type 2
2026-03-28 05:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b55028ee-52c7-5b04-9d94-24b43e31d24b, identifier: PT15230
2026-03-28 05:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-28 05:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-28 05:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230 to the API
2026-03-28 05:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:03Z',
 'fuel_type': 'petrol',
 'id': 'b55028ee-52c7-5b04-9d94-24b43e31d24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT15230',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Saving data for PT15230: {'auction_closing_time': 1774713783.0, 'created_time': 1774553081.531024, 'last_price_update_time': 1774676186.121298}
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT15230') HTTP/1.1" 204 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX48966%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for WX48966: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD39203%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for PD39203: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for ES39418: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44550%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for AG44550: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for PA05830: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH79601%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for UH79601: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH02136%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for LH02136: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for RH59786: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV33202%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for YV33202: 0
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-28 05:36:26 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK13262%27 HTTP/1.1" 200 None
2026-03-28 05:36:26 [auto1.de] INFO: Scrape type for DK13262: 0
2026-03-28 05:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:27 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 05:36:27 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-28 05:36:27 [auto1.de] INFO: Scrape type for VX41895: 2
2026-03-28 05:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-28 05:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88e9926-bcaa-53be-8fea-ea9cddbfce25 with scrape type 2
2026-03-28 05:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a88e9926-bcaa-53be-8fea-ea9cddbfce25 with scrape type 2
2026-03-28 05:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a88e9926-bcaa-53be-8fea-ea9cddbfce25, identifier: VX41895
2026-03-28 05:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-28 05:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-28 05:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895 to the API
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:26Z',
 'fuel_type': 'petrol',
 'id': 'a88e9926-bcaa-53be-8fea-ea9cddbfce25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX41895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 135198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Saving data for VX41895: {'auction_closing_time': 1774717166.0, 'created_time': 1774551402.960277, 'last_price_update_time': 1774676188.106171}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX41895') HTTP/1.1" 204 0
2026-03-28 05:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for LF00427: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY00361%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for MY00361: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH07331%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for MH07331: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL85444%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for HL85444: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for DZ95000: 2
2026-03-28 05:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-28 05:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with scrape type 2
2026-03-28 05:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with scrape type 2
2026-03-28 05:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c271874-6ef0-5da4-a69e-2bdf29a77a93, identifier: DZ95000
2026-03-28 05:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-28 05:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-28 05:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000 to the API
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:17:41Z',
 'fuel_type': 'petrol',
 'id': '5c271874-6ef0-5da4-a69e-2bdf29a77a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ95000',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 83552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-03',
 'seller_name': None,
 'title': 'BMW 2er 225i Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2014}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Saving data for DZ95000: {'auction_closing_time': 1774714661.0, 'created_time': 1774550599.040566, 'last_price_update_time': 1774676188.693264}
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ95000') HTTP/1.1" 204 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM88485%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for XM88485: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for XT03032: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for NE74286: 0
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 05:36:28 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB94191%27 HTTP/1.1" 200 None
2026-03-28 05:36:28 [auto1.de] INFO: Scrape type for XB94191: 2
2026-03-28 05:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae07dae8-82cf-57c2-b29f-1bbc0aff146c with identifier: XB94191
2026-03-28 05:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae07dae8-82cf-57c2-b29f-1bbc0aff146c with scrape type 2
2026-03-28 05:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae07dae8-82cf-57c2-b29f-1bbc0aff146c with scrape type 2
2026-03-28 05:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae07dae8-82cf-57c2-b29f-1bbc0aff146c, identifier: XB94191
2026-03-28 05:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae07dae8-82cf-57c2-b29f-1bbc0aff146c with identifier: XB94191
2026-03-28 05:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae07dae8-82cf-57c2-b29f-1bbc0aff146c with identifier: XB94191
2026-03-28 05:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae07dae8-82cf-57c2-b29f-1bbc0aff146c with identifier: XB94191 to the API
2026-03-28 05:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:25:15Z',
 'fuel_type': 'diesel',
 'id': 'ae07dae8-82cf-57c2-b29f-1bbc0aff146c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB94191',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 64279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-12',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB94191%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Saving data for XB94191: {'auction_closing_time': 1774715115.0, 'created_time': 1773383868.235399, 'last_price_update_time': 1774676189.271781}
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB94191') HTTP/1.1" 204 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for EP96455: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for SS86318: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC07570%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for TC07570: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY97327%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for ZY97327: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for ES68106: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP39031%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for GP39031: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for ZM28041: 0
2026-03-28 05:36:29 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-28 05:36:29 [auto1.de] INFO: Scrape type for TJ20795: 0
2026-03-28 05:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:30 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-28 05:36:30 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Scrape type for MF63690: 2
2026-03-28 05:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-28 05:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664e7065-ef6e-59eb-a282-fbd07118a30c with scrape type 2
2026-03-28 05:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664e7065-ef6e-59eb-a282-fbd07118a30c with scrape type 2
2026-03-28 05:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 664e7065-ef6e-59eb-a282-fbd07118a30c, identifier: MF63690
2026-03-28 05:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-28 05:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-28 05:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690 to the API
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:05:31Z',
 'fuel_type': 'diesel',
 'id': '664e7065-ef6e-59eb-a282-fbd07118a30c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF63690',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 153906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-28 05:36:30 [auto1.de] INFO: Saving data for MF63690: {'auction_closing_time': 1774713931.0, 'created_time': 1774553250.849015, 'last_price_update_time': 1774676190.902408}
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF63690') HTTP/1.1" 204 0
2026-03-28 05:36:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13960%27 HTTP/1.1" 200 None
2026-03-28 05:36:31 [auto1.de] INFO: Scrape type for TU13960: 0
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-28 05:36:31 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-28 05:36:31 [auto1.de] INFO: Scrape type for DR68264: 2
2026-03-28 05:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-28 05:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d155f651-9e3e-5a89-a4c4-a909f73050f0 with scrape type 2
2026-03-28 05:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d155f651-9e3e-5a89-a4c4-a909f73050f0 with scrape type 2
2026-03-28 05:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d155f651-9e3e-5a89-a4c4-a909f73050f0, identifier: DR68264
2026-03-28 05:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-28 05:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-28 05:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264 to the API
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:15:31Z',
 'fuel_type': 'petrol',
 'id': 'd155f651-9e3e-5a89-a4c4-a909f73050f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR68264',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 263254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Life Gewinner Caddy',
 'transmission': 'manual',
 'trim': 'Life Gewinner',
 'year': 2009}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Saving data for DR68264: {'auction_closing_time': 1774714531.0, 'created_time': 1774551037.011668, 'last_price_update_time': 1774676192.165617}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR68264') HTTP/1.1" 204 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB62140%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for LB62140: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT89497%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for WT89497: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH63715%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for HH63715: 2
2026-03-28 05:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aad825a-89d0-50d8-b92d-20c21acfd253 with identifier: HH63715
2026-03-28 05:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aad825a-89d0-50d8-b92d-20c21acfd253 with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aad825a-89d0-50d8-b92d-20c21acfd253 with scrape type 2
2026-03-28 05:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aad825a-89d0-50d8-b92d-20c21acfd253, identifier: HH63715
2026-03-28 05:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aad825a-89d0-50d8-b92d-20c21acfd253 with identifier: HH63715
2026-03-28 05:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aad825a-89d0-50d8-b92d-20c21acfd253 with identifier: HH63715
2026-03-28 05:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aad825a-89d0-50d8-b92d-20c21acfd253 with identifier: HH63715 to the API
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:31:55Z',
 'fuel_type': 'petrol',
 'id': '0aad825a-89d0-50d8-b92d-20c21acfd253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH63715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 55452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH63715%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Saving data for HH63715: {'auction_closing_time': 1774715515.0, 'created_time': 1774464230.745773, 'last_price_update_time': 1774676192.675987}
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH63715') HTTP/1.1" 204 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: RG80046
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE16433%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for HE16433: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD20981%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for GD20981: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF70646%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for LF70646: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE17394%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for GE17394: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for LA48706: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-28 05:36:32 [auto1.de] INFO: Scrape type for AF76763: 0
2026-03-28 05:36:32 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 05:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:33 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN33524%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for ZN33524: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14799%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for JM14799: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for XR01056: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for WZ86962: 0
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-28 05:36:33 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-28 05:36:33 [auto1.de] INFO: Scrape type for BS30478: 2
2026-03-28 05:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-28 05:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937251a1-fa73-558e-991e-76bb20e492ca with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 937251a1-fa73-558e-991e-76bb20e492ca with scrape type 2
2026-03-28 05:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 937251a1-fa73-558e-991e-76bb20e492ca, identifier: BS30478
2026-03-28 05:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-28 05:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-28 05:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478 to the API
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:36:41Z',
 'fuel_type': 'petrol',
 'id': '937251a1-fa73-558e-991e-76bb20e492ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS30478',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 129793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2014}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Saving data for BS30478: {'auction_closing_time': 1774715801.0, 'created_time': 1774550325.429398, 'last_price_update_time': 1774676194.270591}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS30478') HTTP/1.1" 204 0
2026-03-28 05:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for ZH34670: 2
2026-03-28 05:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-28 05:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea451211-25d3-58b9-8828-88d99d3fbf99 with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea451211-25d3-58b9-8828-88d99d3fbf99 with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea451211-25d3-58b9-8828-88d99d3fbf99, identifier: ZH34670
2026-03-28 05:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-28 05:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-28 05:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670 to the API
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:32:58Z',
 'fuel_type': 'petrol',
 'id': 'ea451211-25d3-58b9-8828-88d99d3fbf99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH34670',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2021}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Saving data for ZH34670: {'auction_closing_time': 1774715578.0, 'created_time': 1774552733.628097, 'last_price_update_time': 1774676194.865167}
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH34670') HTTP/1.1" 204 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA84499%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for XA84499: 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH93175%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for DH93175: 0
2026-03-28 05:36:34 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-28 05:36:34 [auto1.de] INFO: Scrape type for XF69711: 2
2026-03-28 05:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-28 05:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with scrape type 2
2026-03-28 05:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5859ba65-7950-5548-88d1-6d9d4cf35eb6, identifier: XF69711
2026-03-28 05:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-28 05:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-28 05:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711 to the API
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:02:07Z',
 'fuel_type': 'petrol',
 'id': '5859ba65-7950-5548-88d1-6d9d4cf35eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF69711',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 169038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-25',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Saving data for XF69711: {'auction_closing_time': 1774713727.0, 'created_time': 1773945945.433902, 'last_price_update_time': 1774676195.311841}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF69711') HTTP/1.1" 204 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: NU93751
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB42175%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for JB42175: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ35206%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for XJ35206: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG99324%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for YG99324: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74613%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for FJ74613: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR99901%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for PR99901: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ87927%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for EJ87927: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for TU83793: 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56152%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Scrape type for LE56152: 2
2026-03-28 05:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0410bb5-5db9-56a0-8513-d215eda21d5c with identifier: LE56152
2026-03-28 05:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0410bb5-5db9-56a0-8513-d215eda21d5c with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0410bb5-5db9-56a0-8513-d215eda21d5c with scrape type 2
2026-03-28 05:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0410bb5-5db9-56a0-8513-d215eda21d5c, identifier: LE56152
2026-03-28 05:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0410bb5-5db9-56a0-8513-d215eda21d5c with identifier: LE56152
2026-03-28 05:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0410bb5-5db9-56a0-8513-d215eda21d5c with identifier: LE56152
2026-03-28 05:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0410bb5-5db9-56a0-8513-d215eda21d5c with identifier: LE56152 to the API
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:15:10Z',
 'fuel_type': 'diesel',
 'id': 'b0410bb5-5db9-56a0-8513-d215eda21d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE56152',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 23532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-25',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue XLT 4WD Doppelkabine',
 'transmission': 'manual',
 'trim': 'XLT 4WD Doppelkabine',
 'year': 2025}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56152%27 HTTP/1.1" 200 None
2026-03-28 05:36:35 [auto1.de] INFO: Saving data for LE56152: {'auction_closing_time': 1774714510.0, 'created_time': 1774552730.62542, 'last_price_update_time': 1774676195.872638}
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE56152') HTTP/1.1" 204 0
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-28 05:36:35 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 05:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for AJ08614: 2
2026-03-28 05:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-28 05:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1261c42-a09f-5dc0-a746-c2dba11ccda8 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1261c42-a09f-5dc0-a746-c2dba11ccda8 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1261c42-a09f-5dc0-a746-c2dba11ccda8, identifier: AJ08614
2026-03-28 05:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-28 05:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-28 05:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614 to the API
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:59:04Z',
 'fuel_type': 'diesel',
 'id': 'b1261c42-a09f-5dc0-a746-c2dba11ccda8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ08614',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 154709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2018}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Saving data for AJ08614: {'auction_closing_time': 1774717144.0, 'created_time': 1774552680.140897, 'last_price_update_time': 1774676196.439289}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ08614') HTTP/1.1" 204 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL58213%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for DL58213: 0
2026-03-28 05:36:36 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Scrape type for AB27737: 2
2026-03-28 05:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with identifier: AB27737
2026-03-28 05:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with scrape type 2
2026-03-28 05:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96, identifier: AB27737
2026-03-28 05:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with identifier: AB27737
2026-03-28 05:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with identifier: AB27737
2026-03-28 05:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96 with identifier: AB27737 to the API
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:52:19Z',
 'fuel_type': 'diesel',
 'id': 'e6c6cb84-fd46-5bc6-992c-3fcfa27dfe96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB27737',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 139727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-28 05:36:36 [auto1.de] INFO: Saving data for AB27737: {'auction_closing_time': 1774716739.0, 'created_time': 1774553181.364659, 'last_price_update_time': 1774676196.896527}
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB27737') HTTP/1.1" 204 0
2026-03-28 05:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:37 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF01952%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for BF01952: 0
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for GR38931: 2
2026-03-28 05:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-28 05:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0465093-343d-5765-a513-88314dfeba45 with scrape type 2
2026-03-28 05:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0465093-343d-5765-a513-88314dfeba45 with scrape type 2
2026-03-28 05:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0465093-343d-5765-a513-88314dfeba45, identifier: GR38931
2026-03-28 05:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-28 05:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-28 05:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931 to the API
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'petrol',
 'id': 'e0465093-343d-5765-a513-88314dfeba45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR38931',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 54996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Way',
 'transmission': 'manual',
 'trim': 'N-Way',
 'year': 2020}
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Saving data for GR38931: {'auction_closing_time': 1774716882.0, 'created_time': 1773230343.995948, 'last_price_update_time': 1774676197.705203}
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR38931') HTTP/1.1" 204 0
2026-03-28 05:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:37 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-28 05:36:37 [auto1.de] INFO: Scrape type for MZ39955: 2
2026-03-28 05:36:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with identifier: MZ39955
2026-03-28 05:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with scrape type 2
2026-03-28 05:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with scrape type 2
2026-03-28 05:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890, identifier: MZ39955
2026-03-28 05:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with identifier: MZ39955
2026-03-28 05:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with identifier: MZ39955
2026-03-28 05:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890 with identifier: MZ39955 to the API
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:43:43Z',
 'fuel_type': 'diesel',
 'id': 'bf57a4c0-5c8e-58ef-8a3d-c27ba8b93890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ39955',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 171259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-11',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Saving data for MZ39955: {'auction_closing_time': 1774716223.0, 'created_time': 1774552707.680774, 'last_price_update_time': 1774676198.282188}
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ39955') HTTP/1.1" 204 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for FG55582: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX73004%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for FX73004: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for MH20468: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC32553%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for BC32553: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR77666%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for TR77666: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC31452%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for YC31452: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT50255%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for UT50255: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV92241%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for KV92241: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: VE56470
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD16653%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for ZD16653: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL10476%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for FL10476: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW55427%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for HW55427: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: XU94698
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for HA89318: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF29678%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for VF29678: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 05:36:38 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU76096%27 HTTP/1.1" 200 None
2026-03-28 05:36:38 [auto1.de] INFO: Scrape type for KU76096: 0
2026-03-28 05:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:40 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for SD83034: 2
2026-03-28 05:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a22d0e2-b26d-506a-b989-009514f23f3f with identifier: SD83034
2026-03-28 05:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a22d0e2-b26d-506a-b989-009514f23f3f with scrape type 2
2026-03-28 05:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a22d0e2-b26d-506a-b989-009514f23f3f with scrape type 2
2026-03-28 05:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a22d0e2-b26d-506a-b989-009514f23f3f, identifier: SD83034
2026-03-28 05:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a22d0e2-b26d-506a-b989-009514f23f3f with identifier: SD83034
2026-03-28 05:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a22d0e2-b26d-506a-b989-009514f23f3f with identifier: SD83034
2026-03-28 05:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a22d0e2-b26d-506a-b989-009514f23f3f with identifier: SD83034 to the API
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:04Z',
 'fuel_type': 'petrol',
 'id': '7a22d0e2-b26d-506a-b989-009514f23f3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD83034',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 52117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2020}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Saving data for SD83034: {'auction_closing_time': 1774715944.0, 'created_time': 1774550608.988926, 'last_price_update_time': 1774676200.645242}
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD83034') HTTP/1.1" 204 0
2026-03-28 05:36:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG64881%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for NG64881: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: TD78857
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD78857%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for TD78857: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB68702%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for WB68702: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: TA30581
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30581%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for TA30581: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH17356%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for KH17356: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL57324%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for XL57324: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH62381%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for WH62381: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG00767%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for AG00767: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42826%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for GJ42826: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY66816%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for DY66816: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS73841%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for TS73841: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for KZ47858: 0
2026-03-28 05:36:40 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-28 05:36:40 [auto1.de] INFO: Scrape type for HD30169: 2
2026-03-28 05:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdc3710-8014-58a2-88e4-d10760f307d0 with identifier: HD30169
2026-03-28 05:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdc3710-8014-58a2-88e4-d10760f307d0 with scrape type 2
2026-03-28 05:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcdc3710-8014-58a2-88e4-d10760f307d0 with scrape type 2
2026-03-28 05:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdc3710-8014-58a2-88e4-d10760f307d0, identifier: HD30169
2026-03-28 05:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdc3710-8014-58a2-88e4-d10760f307d0 with identifier: HD30169
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 05:36:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdc3710-8014-58a2-88e4-d10760f307d0 with identifier: HD30169
2026-03-28 05:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdc3710-8014-58a2-88e4-d10760f307d0 with identifier: HD30169 to the API
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'diesel',
 'id': 'fcdc3710-8014-58a2-88e4-d10760f307d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD30169',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 101240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-22',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L2 Trend',
 'transmission': 'automatic',
 'trim': '320 L2 Trend',
 'year': 2018}
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Saving data for HD30169: {'auction_closing_time': 1774716148.0, 'created_time': 1773917307.826932, 'last_price_update_time': 1774676201.533473}
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD30169') HTTP/1.1" 204 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR18701%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for PR18701: 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ20734%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for NZ20734: 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: CR46932
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for RB81159: 0
2026-03-28 05:36:41 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD15410%27 HTTP/1.1" 200 None
2026-03-28 05:36:41 [auto1.de] INFO: Scrape type for GD15410: 2
2026-03-28 05:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31852a89-1d08-5f3e-8994-8a17d6b696cc with identifier: GD15410
2026-03-28 05:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31852a89-1d08-5f3e-8994-8a17d6b696cc with scrape type 2
2026-03-28 05:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31852a89-1d08-5f3e-8994-8a17d6b696cc with scrape type 2
2026-03-28 05:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31852a89-1d08-5f3e-8994-8a17d6b696cc, identifier: GD15410
2026-03-28 05:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31852a89-1d08-5f3e-8994-8a17d6b696cc with identifier: GD15410
2026-03-28 05:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31852a89-1d08-5f3e-8994-8a17d6b696cc with identifier: GD15410
2026-03-28 05:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31852a89-1d08-5f3e-8994-8a17d6b696cc with identifier: GD15410 to the API
2026-03-28 05:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:09Z',
 'fuel_type': 'diesel',
 'id': '31852a89-1d08-5f3e-8994-8a17d6b696cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD15410',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 211970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2017}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD15410%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Saving data for GD15410: {'auction_closing_time': 1774716669.0, 'created_time': 1773303378.290152, 'last_price_update_time': 1774676202.206485}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD15410') HTTP/1.1" 204 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for MZ83474: 2
2026-03-28 05:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-28 05:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2c23a9-dd47-506a-9c22-5461eb9b3e04 with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2c23a9-dd47-506a-9c22-5461eb9b3e04 with scrape type 2
2026-03-28 05:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2c23a9-dd47-506a-9c22-5461eb9b3e04, identifier: MZ83474
2026-03-28 05:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-28 05:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-28 05:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474 to the API
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:19:01Z',
 'fuel_type': 'diesel',
 'id': 'af2c23a9-dd47-506a-9c22-5461eb9b3e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83474',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 186603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-21',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t',
 'year': 2011}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Saving data for MZ83474: {'auction_closing_time': 1774714741.0, 'created_time': 1774552908.155593, 'last_price_update_time': 1774676202.66334}
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ83474') HTTP/1.1" 204 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV62209%27 HTTP/1.1" 200 None
2026-03-28 05:36:42 [auto1.de] INFO: Scrape type for EV62209: 0
2026-03-28 05:36:42 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-28 05:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:43 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG76747%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for LG76747: 0
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-28 05:36:43 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-28 05:36:43 [auto1.de] INFO: Scrape type for DK33698: 2
2026-03-28 05:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-28 05:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da916fca-db24-5d3d-96bf-44deaeab1f0a with scrape type 2
2026-03-28 05:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da916fca-db24-5d3d-96bf-44deaeab1f0a with scrape type 2
2026-03-28 05:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da916fca-db24-5d3d-96bf-44deaeab1f0a, identifier: DK33698
2026-03-28 05:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-28 05:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-28 05:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698 to the API
2026-03-28 05:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:23:03Z',
 'fuel_type': 'petrol',
 'id': 'da916fca-db24-5d3d-96bf-44deaeab1f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK33698',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 285134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 MIVEC Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2011}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Saving data for DK33698: {'auction_closing_time': 1774714983.0, 'created_time': 1774551850.082415, 'last_price_update_time': 1774676204.214051}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK33698') HTTP/1.1" 204 0
2026-03-28 05:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR53329%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Scrape type for FR53329: 2
2026-03-28 05:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6315ca7c-bc5c-5e88-985a-20af34fcc276 with identifier: FR53329
2026-03-28 05:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6315ca7c-bc5c-5e88-985a-20af34fcc276 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6315ca7c-bc5c-5e88-985a-20af34fcc276 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6315ca7c-bc5c-5e88-985a-20af34fcc276, identifier: FR53329
2026-03-28 05:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6315ca7c-bc5c-5e88-985a-20af34fcc276 with identifier: FR53329
2026-03-28 05:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6315ca7c-bc5c-5e88-985a-20af34fcc276 with identifier: FR53329
2026-03-28 05:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6315ca7c-bc5c-5e88-985a-20af34fcc276 with identifier: FR53329 to the API
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:34:36Z',
 'fuel_type': 'petrol',
 'id': '6315ca7c-bc5c-5e88-985a-20af34fcc276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR53329',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 202172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR53329%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Saving data for FR53329: {'auction_closing_time': 1774715676.0, 'created_time': 1774349811.594285, 'last_price_update_time': 1774676204.758147}
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR53329') HTTP/1.1" 204 0
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Scrape type for SV36392: 0
2026-03-28 05:36:44 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-28 05:36:44 [auto1.de] INFO: Scrape type for EU33293: 2
2026-03-28 05:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with identifier: EU33293
2026-03-28 05:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with scrape type 2
2026-03-28 05:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cfced23-d6b3-5913-a32c-c2e59a5c8668, identifier: EU33293
2026-03-28 05:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with identifier: EU33293
2026-03-28 05:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with identifier: EU33293
2026-03-28 05:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cfced23-d6b3-5913-a32c-c2e59a5c8668 with identifier: EU33293 to the API
2026-03-28 05:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:38:01Z',
 'fuel_type': 'petrol',
 'id': '1cfced23-d6b3-5913-a32c-c2e59a5c8668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU33293',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 176498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Saving data for EU33293: {'auction_closing_time': 1774715881.0, 'created_time': 1774552769.001151, 'last_price_update_time': 1774676205.211057}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU33293') HTTP/1.1" 204 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48323%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for KU48323: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC23604%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for GC23604: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for LU02094: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH29629%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for XH29629: 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96665%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for YY96665: 2
2026-03-28 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with identifier: YY96665
2026-03-28 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71dbdc8a-61c6-5d3d-aa82-c14118cd175c, identifier: YY96665
2026-03-28 05:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with identifier: YY96665
2026-03-28 05:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with identifier: YY96665
2026-03-28 05:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71dbdc8a-61c6-5d3d-aa82-c14118cd175c with identifier: YY96665 to the API
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:49Z',
 'fuel_type': 'petrol',
 'id': '71dbdc8a-61c6-5d3d-aa82-c14118cd175c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY96665',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 163318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-06',
 'seller_name': None,
 'title': 'Ford Kuga 1.6 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96665%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Saving data for YY96665: {'auction_closing_time': 1774715509.0, 'created_time': 1773306615.725361, 'last_price_update_time': 1774676205.765238}
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY96665') HTTP/1.1" 204 0
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 05:36:45 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-28 05:36:45 [auto1.de] INFO: Scrape type for LW43153: 2
2026-03-28 05:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-28 05:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7264dd34-9fca-539c-8e84-4b781714c703 with scrape type 2
2026-03-28 05:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7264dd34-9fca-539c-8e84-4b781714c703 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7264dd34-9fca-539c-8e84-4b781714c703, identifier: LW43153
2026-03-28 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-28 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153
2026-03-28 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7264dd34-9fca-539c-8e84-4b781714c703 with identifier: LW43153 to the API
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-28T16:58:03Z',
 'fuel_type': 'petrol',
 'id': '7264dd34-9fca-539c-8e84-4b781714c703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW43153',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 129037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2017}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Saving data for LW43153: {'auction_closing_time': 1774717083.0, 'created_time': 1773226390.338949, 'last_price_update_time': 1774676206.387983}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW43153') HTTP/1.1" 204 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for LP76245: 2
2026-03-28 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-28 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ba641a-6239-58f8-920f-96852ec825d0 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ba641a-6239-58f8-920f-96852ec825d0 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ba641a-6239-58f8-920f-96852ec825d0, identifier: LP76245
2026-03-28 05:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-28 05:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-28 05:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245 to the API
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:28Z',
 'fuel_type': 'petrol',
 'id': '11ba641a-6239-58f8-920f-96852ec825d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP76245',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 54984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.3 TCe Stepway Plus',
 'transmission': 'manual',
 'trim': 'Stepway Plus',
 'year': 2020}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Saving data for LP76245: {'auction_closing_time': 1774716748.0, 'created_time': 1774552948.51638, 'last_price_update_time': 1774676206.84659}
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP76245') HTTP/1.1" 204 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV36332%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for TV36332: 0
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-28 05:36:46 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-28 05:36:46 [auto1.de] INFO: Scrape type for VE08810: 2
2026-03-28 05:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-28 05:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c4f346-9754-570a-9cd3-6eb6442f9f43 with scrape type 2
2026-03-28 05:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c4f346-9754-570a-9cd3-6eb6442f9f43 with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c4f346-9754-570a-9cd3-6eb6442f9f43, identifier: VE08810
2026-03-28 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-28 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-28 05:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810 to the API
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:00:14Z',
 'fuel_type': 'electro',
 'id': 'a4c4f346-9754-570a-9cd3-6eb6442f9f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE08810',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 53052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2020}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Saving data for VE08810: {'auction_closing_time': 1774713614.0, 'created_time': 1774550436.293509, 'last_price_update_time': 1774676207.343326}
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE08810') HTTP/1.1" 204 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL49521%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for FL49521: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for NF88064: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for LP44310: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for HX92939: 0
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43981%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for AC43981: 0
2026-03-28 05:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:47 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:47 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69787%27 HTTP/1.1" 200 None
2026-03-28 05:36:47 [auto1.de] INFO: Scrape type for MC69787: 2
2026-03-28 05:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with identifier: MC69787
2026-03-28 05:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with scrape type 2
2026-03-28 05:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53fb256e-1688-5b96-ad5d-4a4f69b888d4, identifier: MC69787
2026-03-28 05:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with identifier: MC69787
2026-03-28 05:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with identifier: MC69787
2026-03-28 05:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53fb256e-1688-5b96-ad5d-4a4f69b888d4 with identifier: MC69787 to the API
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:23:26Z',
 'fuel_type': 'petrol',
 'id': '53fb256e-1688-5b96-ad5d-4a4f69b888d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC69787',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 42920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-26',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2020}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69787%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Saving data for MC69787: {'auction_closing_time': 1774715006.0, 'created_time': 1774552643.697277, 'last_price_update_time': 1774676208.112115}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC69787') HTTP/1.1" 204 0
2026-03-28 05:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR20682%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for CR20682: 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for CL87720: 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for NV55096: 2
2026-03-28 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-28 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142cca33-44b9-574c-8a3a-fd728a819bef with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142cca33-44b9-574c-8a3a-fd728a819bef with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142cca33-44b9-574c-8a3a-fd728a819bef, identifier: NV55096
2026-03-28 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-28 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-28 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096 to the API
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:28:58Z',
 'fuel_type': 'petrol',
 'id': '142cca33-44b9-574c-8a3a-fd728a819bef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV55096',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 50298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2016}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Saving data for NV55096: {'auction_closing_time': 1774715338.0, 'created_time': 1774552684.965515, 'last_price_update_time': 1774676208.611351}
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV55096') HTTP/1.1" 204 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM83584%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for AM83584: 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for VS58629: 0
2026-03-28 05:36:48 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-28 05:36:48 [auto1.de] INFO: Scrape type for KV33048: 2
2026-03-28 05:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-28 05:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with scrape type 2
2026-03-28 05:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afacaa44-7570-5bbc-b22c-407a3e8d3fb2, identifier: KV33048
2026-03-28 05:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-28 05:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-28 05:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048 to the API
2026-03-28 05:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:10:25Z',
 'fuel_type': 'diesel',
 'id': 'afacaa44-7570-5bbc-b22c-407a3e8d3fb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV33048',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 105214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.2 CRDi Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2019}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Saving data for KV33048: {'auction_closing_time': 1774714225.0, 'created_time': 1774551412.786391, 'last_price_update_time': 1774676209.20286}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33048') HTTP/1.1" 204 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for HX55522: 2
2026-03-28 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-28 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7, identifier: HX55522
2026-03-28 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-28 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-28 05:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522 to the API
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:11:32Z',
 'fuel_type': 'diesel',
 'id': '3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX55522',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 149793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2017}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Saving data for HX55522: {'auction_closing_time': 1774714292.0, 'created_time': 1774553199.28481, 'last_price_update_time': 1774676209.627436}
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX55522') HTTP/1.1" 204 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for ZX12399: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW04232%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for TW04232: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21228%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for FV21228: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for RG95107: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG34327%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for FG34327: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ20331%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for BJ20331: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX55902%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for TX55902: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV72742%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for WV72742: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP63027%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for BP63027: 0
2026-03-28 05:36:49 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-28 05:36:49 [auto1.de] INFO: Scrape type for LB03108: 2
2026-03-28 05:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-28 05:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b9152bf-76e1-555b-8688-3c694576e5ba with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b9152bf-76e1-555b-8688-3c694576e5ba with scrape type 2
2026-03-28 05:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b9152bf-76e1-555b-8688-3c694576e5ba, identifier: LB03108
2026-03-28 05:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-28 05:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-28 05:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108 to the API
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:28Z',
 'fuel_type': 'petrol',
 'id': '4b9152bf-76e1-555b-8688-3c694576e5ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB03108',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 176048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Saving data for LB03108: {'auction_closing_time': 1774714168.0, 'created_time': 1774552899.742158, 'last_price_update_time': 1774676210.251926}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB03108') HTTP/1.1" 204 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for ED43113: 2
2026-03-28 05:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047076a9-7d79-5eb4-a906-cc1b26255a2f with identifier: ED43113
2026-03-28 05:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047076a9-7d79-5eb4-a906-cc1b26255a2f with scrape type 2
2026-03-28 05:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047076a9-7d79-5eb4-a906-cc1b26255a2f with scrape type 2
2026-03-28 05:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 047076a9-7d79-5eb4-a906-cc1b26255a2f, identifier: ED43113
2026-03-28 05:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 047076a9-7d79-5eb4-a906-cc1b26255a2f with identifier: ED43113
2026-03-28 05:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 047076a9-7d79-5eb4-a906-cc1b26255a2f with identifier: ED43113
2026-03-28 05:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 047076a9-7d79-5eb4-a906-cc1b26255a2f with identifier: ED43113 to the API
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:40:53Z',
 'fuel_type': 'diesel',
 'id': '047076a9-7d79-5eb4-a906-cc1b26255a2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED43113',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 122753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2017}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Saving data for ED43113: {'auction_closing_time': 1774716053.0, 'created_time': 1774553182.398644, 'last_price_update_time': 1774676210.858887}
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED43113') HTTP/1.1" 204 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for UC27013: 0
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-28 05:36:50 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-28 05:36:50 [auto1.de] INFO: Scrape type for GY35476: 2
2026-03-28 05:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-28 05:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with scrape type 2
2026-03-28 05:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with scrape type 2
2026-03-28 05:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdcb2e31-1c78-56df-a3ae-91565a08f6c6, identifier: GY35476
2026-03-28 05:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-28 05:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-28 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476 to the API
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'petrol',
 'id': 'fdcb2e31-1c78-56df-a3ae-91565a08f6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY35476',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 86898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Saving data for GY35476: {'auction_closing_time': 1774715015.0, 'created_time': 1774552976.090875, 'last_price_update_time': 1774676211.312094}
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY35476') HTTP/1.1" 204 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP94467%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for AP94467: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-28 05:36:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:51 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW29404%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for TW29404: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES83380%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for ES83380: 0
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-28 05:36:51 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-28 05:36:51 [auto1.de] INFO: Scrape type for VE57105: 2
2026-03-28 05:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ed32d8-d8f8-5579-aa40-31a8921665aa with identifier: VE57105
2026-03-28 05:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ed32d8-d8f8-5579-aa40-31a8921665aa with scrape type 2
2026-03-28 05:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ed32d8-d8f8-5579-aa40-31a8921665aa with scrape type 2
2026-03-28 05:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7ed32d8-d8f8-5579-aa40-31a8921665aa, identifier: VE57105
2026-03-28 05:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7ed32d8-d8f8-5579-aa40-31a8921665aa with identifier: VE57105
2026-03-28 05:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7ed32d8-d8f8-5579-aa40-31a8921665aa with identifier: VE57105
2026-03-28 05:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7ed32d8-d8f8-5579-aa40-31a8921665aa with identifier: VE57105 to the API
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:47:52Z',
 'fuel_type': 'diesel',
 'id': 'a7ed32d8-d8f8-5579-aa40-31a8921665aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE57105',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 89563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2020}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Saving data for VE57105: {'auction_closing_time': 1774716472.0, 'created_time': 1774551416.710517, 'last_price_update_time': 1774676212.089439}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE57105') HTTP/1.1" 204 0
2026-03-28 05:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB15869%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for XB15869: 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for FV65723: 2
2026-03-28 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-28 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6fc2f0d-6498-526d-8353-9ca8812dfb90 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6fc2f0d-6498-526d-8353-9ca8812dfb90 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6fc2f0d-6498-526d-8353-9ca8812dfb90, identifier: FV65723
2026-03-28 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-28 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-28 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723 to the API
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'petrol',
 'id': 'e6fc2f0d-6498-526d-8353-9ca8812dfb90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV65723',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 67400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'BMW X4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Saving data for FV65723: {'auction_closing_time': 1774713795.0, 'created_time': 1774551045.332384, 'last_price_update_time': 1774676212.678241}
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV65723') HTTP/1.1" 204 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13517%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for AP13517: 0
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 05:36:52 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-28 05:36:52 [auto1.de] INFO: Scrape type for DV26733: 2
2026-03-28 05:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-28 05:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d686311b-d9e4-5027-b565-f9eda3005a07 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d686311b-d9e4-5027-b565-f9eda3005a07 with scrape type 2
2026-03-28 05:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d686311b-d9e4-5027-b565-f9eda3005a07, identifier: DV26733
2026-03-28 05:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-28 05:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-28 05:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733 to the API
2026-03-28 05:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:43Z',
 'fuel_type': 'petrol',
 'id': 'd686311b-d9e4-5027-b565-f9eda3005a07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV26733',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 149070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Saving data for DV26733: {'auction_closing_time': 1774713763.0, 'created_time': 1774552675.149742, 'last_price_update_time': 1774676213.165293}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV26733') HTTP/1.1" 204 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK42970%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for MK42970: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS83303%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for DS83303: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR06825%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for SR06825: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC88612%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for VC88612: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for FH53485: 2
2026-03-28 05:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82e49a40-872f-5f6a-a8ec-7394e100a391 with identifier: FH53485
2026-03-28 05:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82e49a40-872f-5f6a-a8ec-7394e100a391 with scrape type 2
2026-03-28 05:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82e49a40-872f-5f6a-a8ec-7394e100a391 with scrape type 2
2026-03-28 05:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82e49a40-872f-5f6a-a8ec-7394e100a391, identifier: FH53485
2026-03-28 05:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82e49a40-872f-5f6a-a8ec-7394e100a391 with identifier: FH53485
2026-03-28 05:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82e49a40-872f-5f6a-a8ec-7394e100a391 with identifier: FH53485
2026-03-28 05:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82e49a40-872f-5f6a-a8ec-7394e100a391 with identifier: FH53485 to the API
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:47:46Z',
 'fuel_type': 'diesel',
 'id': '82e49a40-872f-5f6a-a8ec-7394e100a391',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH53485',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 128703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-23',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Saving data for FH53485: {'auction_closing_time': 1774716466.0, 'created_time': 1774551469.365268, 'last_price_update_time': 1774676213.672634}
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH53485') HTTP/1.1" 204 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-28 05:36:53 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-28 05:36:53 [auto1.de] INFO: Scrape type for WX33301: 2
2026-03-28 05:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-28 05:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with scrape type 2
2026-03-28 05:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with scrape type 2
2026-03-28 05:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4, identifier: WX33301
2026-03-28 05:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-28 05:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301
2026-03-28 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fbfeae0-0be5-563f-bd16-ef0e95d041b4 with identifier: WX33301 to the API
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:59:53Z',
 'fuel_type': 'diesel',
 'id': '5fbfeae0-0be5-563f-bd16-ef0e95d041b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX33301',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 53868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2020}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Saving data for WX33301: {'auction_closing_time': 1774717193.0, 'created_time': 1774466564.24714, 'last_price_update_time': 1774676214.235204}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX33301') HTTP/1.1" 204 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ03790%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for FJ03790: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX25760%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for HX25760: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for DG36538: 2
2026-03-28 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-28 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8, identifier: DG36538
2026-03-28 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-28 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-28 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538 to the API
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:30:29Z',
 'fuel_type': 'diesel',
 'id': '82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG36538',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 78601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 250 d 4Matic Doppelkabine Edition Power',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Edition Power',
 'year': 2017}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Saving data for DG36538: {'auction_closing_time': 1774715429.0, 'created_time': 1773945727.376646, 'last_price_update_time': 1774676214.742287}
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG36538') HTTP/1.1" 204 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM73254%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for VM73254: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-28 05:36:54 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-28 05:36:54 [auto1.de] INFO: Scrape type for CX50338: 2
2026-03-28 05:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-28 05:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d115ce54-34c9-5b42-81f1-b677f7d4edca with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d115ce54-34c9-5b42-81f1-b677f7d4edca with scrape type 2
2026-03-28 05:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d115ce54-34c9-5b42-81f1-b677f7d4edca, identifier: CX50338
2026-03-28 05:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-28 05:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-28 05:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338 to the API
2026-03-28 05:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:33Z',
 'fuel_type': 'petrol',
 'id': 'd115ce54-34c9-5b42-81f1-b677f7d4edca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX50338',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 116303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-28 05:36:55 [auto1.de] INFO: Saving data for CX50338: {'auction_closing_time': 1774716813.0, 'created_time': 1774553109.210902, 'last_price_update_time': 1774676215.205044}
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX50338') HTTP/1.1" 204 0
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 05:36:55 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 05:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:56 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD44688%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for ZD44688: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17683%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for UD17683: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH18397%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for SH18397: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for XS25100: 2
2026-03-28 05:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-28 05:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710408a8-254f-50ff-bef6-e430bc7bef7b with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710408a8-254f-50ff-bef6-e430bc7bef7b with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710408a8-254f-50ff-bef6-e430bc7bef7b, identifier: XS25100
2026-03-28 05:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-28 05:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-28 05:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100 to the API
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:09Z',
 'fuel_type': 'petrol',
 'id': '710408a8-254f-50ff-bef6-e430bc7bef7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS25100',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 61077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-22',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2019}
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Saving data for XS25100: {'auction_closing_time': 1774713969.0, 'created_time': 1774550633.808742, 'last_price_update_time': 1774676216.829948}
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS25100') HTTP/1.1" 204 0
2026-03-28 05:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for UK63954: 0
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-28 05:36:56 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR45801%27 HTTP/1.1" 200 None
2026-03-28 05:36:56 [auto1.de] INFO: Scrape type for SR45801: 2
2026-03-28 05:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbe36bd-af97-5149-bc2d-07763d672c3d with identifier: SR45801
2026-03-28 05:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbe36bd-af97-5149-bc2d-07763d672c3d with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbe36bd-af97-5149-bc2d-07763d672c3d with scrape type 2
2026-03-28 05:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbe36bd-af97-5149-bc2d-07763d672c3d, identifier: SR45801
2026-03-28 05:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbe36bd-af97-5149-bc2d-07763d672c3d with identifier: SR45801
2026-03-28 05:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbe36bd-af97-5149-bc2d-07763d672c3d with identifier: SR45801
2026-03-28 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbe36bd-af97-5149-bc2d-07763d672c3d with identifier: SR45801 to the API
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:29:32Z',
 'fuel_type': 'petrol',
 'id': '7cbe36bd-af97-5149-bc2d-07763d672c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR45801',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 47102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-14',
 'seller_name': None,
 'title': 'Fiat 500C 1.4 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR45801%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Saving data for SR45801: {'auction_closing_time': 1774715372.0, 'created_time': 1774553210.387569, 'last_price_update_time': 1774676217.280097}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR45801') HTTP/1.1" 204 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for NY59732: 2
2026-03-28 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-28 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cfba0c-a32e-50ec-8e26-2e09367ae33b with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cfba0c-a32e-50ec-8e26-2e09367ae33b with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cfba0c-a32e-50ec-8e26-2e09367ae33b, identifier: NY59732
2026-03-28 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-28 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-28 05:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732 to the API
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:15:05Z',
 'fuel_type': 'diesel',
 'id': 'b7cfba0c-a32e-50ec-8e26-2e09367ae33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY59732',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 128028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Saving data for NY59732: {'auction_closing_time': 1774714505.0, 'created_time': 1774553154.088329, 'last_price_update_time': 1774676217.797992}
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY59732') HTTP/1.1" 204 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09948%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for TS09948: 0
2026-03-28 05:36:57 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-28 05:36:57 [auto1.de] INFO: Scrape type for RV14336: 2
2026-03-28 05:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-28 05:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e86bc0-9ee9-5363-be31-21388a0e456c with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e86bc0-9ee9-5363-be31-21388a0e456c with scrape type 2
2026-03-28 05:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e86bc0-9ee9-5363-be31-21388a0e456c, identifier: RV14336
2026-03-28 05:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-28 05:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-28 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336 to the API
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:17Z',
 'fuel_type': 'diesel',
 'id': 'f8e86bc0-9ee9-5363-be31-21388a0e456c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV14336',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 154545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Saving data for RV14336: {'auction_closing_time': 1774714637.0, 'created_time': 1774553018.367042, 'last_price_update_time': 1774676218.319443}
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV14336') HTTP/1.1" 204 0
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Scrape type for XK33490: 0
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY08035%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Scrape type for CY08035: 0
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP29574%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Scrape type for MP29574: 0
2026-03-28 05:36:58 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB34579%27 HTTP/1.1" 200 None
2026-03-28 05:36:58 [auto1.de] INFO: Scrape type for KB34579: 2
2026-03-28 05:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 396e8db7-8d05-5650-afa4-91170a86fb93 with identifier: KB34579
2026-03-28 05:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 396e8db7-8d05-5650-afa4-91170a86fb93 with scrape type 2
2026-03-28 05:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 396e8db7-8d05-5650-afa4-91170a86fb93 with scrape type 2
2026-03-28 05:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 396e8db7-8d05-5650-afa4-91170a86fb93, identifier: KB34579
2026-03-28 05:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 396e8db7-8d05-5650-afa4-91170a86fb93 with identifier: KB34579
2026-03-28 05:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 396e8db7-8d05-5650-afa4-91170a86fb93 with identifier: KB34579
2026-03-28 05:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 396e8db7-8d05-5650-afa4-91170a86fb93 with identifier: KB34579 to the API
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:49Z',
 'fuel_type': 'diesel',
 'id': '396e8db7-8d05-5650-afa4-91170a86fb93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB34579',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 288336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2014}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB34579%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Saving data for KB34579: {'auction_closing_time': 1774716229.0, 'created_time': 1772545586.838097, 'last_price_update_time': 1774676219.078144}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB34579') HTTP/1.1" 204 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV96474%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for PV96474: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for FK56908: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for VS89065: 2
2026-03-28 05:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-28 05:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb346027-6314-5db1-9469-7b1a4eb87cda with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb346027-6314-5db1-9469-7b1a4eb87cda with scrape type 2
2026-03-28 05:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb346027-6314-5db1-9469-7b1a4eb87cda, identifier: VS89065
2026-03-28 05:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-28 05:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-28 05:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065 to the API
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': 'bb346027-6314-5db1-9469-7b1a4eb87cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89065',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 150889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Saving data for VS89065: {'auction_closing_time': 1774715595.0, 'created_time': 1774552820.291533, 'last_price_update_time': 1774676219.593258}
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS89065') HTTP/1.1" 204 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG89224%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for WG89224: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ14955%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for VJ14955: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for GZ29273: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN35186%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for JN35186: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93037%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for WG93037: 0
2026-03-28 05:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:36:59 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9199 | hits on page: 40
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ57242%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for PZ57242: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP89589%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for WP89589: 0
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-28 05:36:59 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-28 05:36:59 [auto1.de] INFO: Scrape type for BW90089: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD78722%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for CD78722: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for SA32858: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS85382%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for CS85382: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP57126%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for NP57126: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF83908%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for CF83908: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49752%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for LS49752: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for GW15546: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN63500%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for XN63500: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD62968%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for WD62968: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA60451%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for SA60451: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW58649%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for EW58649: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76371%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for GZ76371: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM87427%27 HTTP/1.1" 200 None
2026-03-28 05:37:00 [auto1.de] INFO: Scrape type for NM87427: 0
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-28 05:37:00 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-28 05:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:01 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for FH60355: 2
2026-03-28 05:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-28 05:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc44f719-871b-5fcd-b0d2-50c388ca1f4a with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc44f719-871b-5fcd-b0d2-50c388ca1f4a with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc44f719-871b-5fcd-b0d2-50c388ca1f4a, identifier: FH60355
2026-03-28 05:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-28 05:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-28 05:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355 to the API
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:20Z',
 'fuel_type': 'diesel',
 'id': 'fc44f719-871b-5fcd-b0d2-50c388ca1f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH60355',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 101546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'BMW X2 xDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Saving data for FH60355: {'auction_closing_time': 1774713680.0, 'created_time': 1774550607.226633, 'last_price_update_time': 1774676221.757844}
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH60355') HTTP/1.1" 204 0
2026-03-28 05:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-28 05:37:01 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-28 05:37:01 [auto1.de] INFO: Scrape type for ER72643: 2
2026-03-28 05:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-28 05:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ef39b3-2f49-52ff-983e-e95358bc0161 with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ef39b3-2f49-52ff-983e-e95358bc0161 with scrape type 2
2026-03-28 05:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6ef39b3-2f49-52ff-983e-e95358bc0161, identifier: ER72643
2026-03-28 05:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-28 05:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-28 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643 to the API
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:27Z',
 'fuel_type': 'diesel',
 'id': 'c6ef39b3-2f49-52ff-983e-e95358bc0161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER72643',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 125515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join 4Motion',
 'transmission': 'automatic',
 'trim': 'Join 4Motion',
 'year': 2018}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Saving data for ER72643: {'auction_closing_time': 1774715247.0, 'created_time': 1774552712.126785, 'last_price_update_time': 1774676222.318657}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER72643') HTTP/1.1" 204 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH35600%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for CH35600: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP66680%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for JP66680: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for XS93446: 2
2026-03-28 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-28 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c, identifier: XS93446
2026-03-28 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-28 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-28 05:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446 to the API
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:05:49Z',
 'fuel_type': 'petrol',
 'id': 'c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS93446',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 242504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-27',
 'seller_name': None,
 'title': 'Audi S6 5.2 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Saving data for XS93446: {'auction_closing_time': 1774713949.0, 'created_time': 1774553204.657941, 'last_price_update_time': 1774676222.821721}
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS93446') HTTP/1.1" 204 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 05:37:02 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK02801%27 HTTP/1.1" 200 None
2026-03-28 05:37:02 [auto1.de] INFO: Scrape type for EK02801: 2
2026-03-28 05:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with identifier: EK02801
2026-03-28 05:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with scrape type 2
2026-03-28 05:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d695ec99-ffdc-5f6a-aa90-e6a4253fe265, identifier: EK02801
2026-03-28 05:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with identifier: EK02801
2026-03-28 05:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with identifier: EK02801
2026-03-28 05:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d695ec99-ffdc-5f6a-aa90-e6a4253fe265 with identifier: EK02801 to the API
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:06:53Z',
 'fuel_type': 'petrol',
 'id': 'd695ec99-ffdc-5f6a-aa90-e6a4253fe265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK02801',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 59927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-06',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK02801%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Saving data for EK02801: {'auction_closing_time': 1774714013.0, 'created_time': 1773138805.975106, 'last_price_update_time': 1774676223.281442}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK02801') HTTP/1.1" 204 0
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11465%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Scrape type for DH11465: 2
2026-03-28 05:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33f5c770-5981-5dfd-9957-ab662b9f24e6 with identifier: DH11465
2026-03-28 05:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33f5c770-5981-5dfd-9957-ab662b9f24e6 with scrape type 2
2026-03-28 05:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33f5c770-5981-5dfd-9957-ab662b9f24e6 with scrape type 2
2026-03-28 05:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33f5c770-5981-5dfd-9957-ab662b9f24e6, identifier: DH11465
2026-03-28 05:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33f5c770-5981-5dfd-9957-ab662b9f24e6 with identifier: DH11465
2026-03-28 05:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33f5c770-5981-5dfd-9957-ab662b9f24e6 with identifier: DH11465
2026-03-28 05:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33f5c770-5981-5dfd-9957-ab662b9f24e6 with identifier: DH11465 to the API
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:20:42Z',
 'fuel_type': 'petrol',
 'id': '33f5c770-5981-5dfd-9957-ab662b9f24e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH11465',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 171076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11465%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Saving data for DH11465: {'auction_closing_time': 1774714842.0, 'created_time': 1774468240.549721, 'last_price_update_time': 1774676223.827743}
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH11465') HTTP/1.1" 204 0
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA94630%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Scrape type for CA94630: 0
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED51510%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Scrape type for ED51510: 0
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-28 05:37:03 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE97830%27 HTTP/1.1" 200 None
2026-03-28 05:37:03 [auto1.de] INFO: Scrape type for XE97830: 2
2026-03-28 05:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b483a43b-81bd-5584-92fe-a7e08d203075 with identifier: XE97830
2026-03-28 05:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b483a43b-81bd-5584-92fe-a7e08d203075 with scrape type 2
2026-03-28 05:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b483a43b-81bd-5584-92fe-a7e08d203075 with scrape type 2
2026-03-28 05:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b483a43b-81bd-5584-92fe-a7e08d203075, identifier: XE97830
2026-03-28 05:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b483a43b-81bd-5584-92fe-a7e08d203075 with identifier: XE97830
2026-03-28 05:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b483a43b-81bd-5584-92fe-a7e08d203075 with identifier: XE97830
2026-03-28 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b483a43b-81bd-5584-92fe-a7e08d203075 with identifier: XE97830 to the API
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:55Z',
 'fuel_type': 'diesel',
 'id': 'b483a43b-81bd-5584-92fe-a7e08d203075',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE97830',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 51521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2023}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE97830%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Saving data for XE97830: {'auction_closing_time': 1774716595.0, 'created_time': 1774463889.764125, 'last_price_update_time': 1774676224.349884}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE97830') HTTP/1.1" 204 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ19988%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for AJ19988: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for UN86111: 2
2026-03-28 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-28 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff, identifier: UN86111
2026-03-28 05:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-28 05:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-28 05:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111 to the API
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:20Z',
 'fuel_type': 'petrol',
 'id': '3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN86111',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 124942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Saving data for UN86111: {'auction_closing_time': 1774714820.0, 'created_time': 1774552904.516319, 'last_price_update_time': 1774676224.915603}
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN86111') HTTP/1.1" 204 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP02879%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for PP02879: 0
2026-03-28 05:37:04 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-28 05:37:04 [auto1.de] INFO: Scrape type for HE75386: 2
2026-03-28 05:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-28 05:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aff8628-63e8-5804-87f6-1b072e4d3c2e with scrape type 2
2026-03-28 05:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aff8628-63e8-5804-87f6-1b072e4d3c2e with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aff8628-63e8-5804-87f6-1b072e4d3c2e, identifier: HE75386
2026-03-28 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-28 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386
2026-03-28 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aff8628-63e8-5804-87f6-1b072e4d3c2e with identifier: HE75386 to the API
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:25:41Z',
 'fuel_type': 'petrol',
 'id': '4aff8628-63e8-5804-87f6-1b072e4d3c2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE75386',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 40031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-20',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Saving data for HE75386: {'auction_closing_time': 1774715141.0, 'created_time': 1774464554.615906, 'last_price_update_time': 1774676225.404027}
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE75386') HTTP/1.1" 204 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK06365%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for MK06365: 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for TR13972: 0
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-28 05:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:05 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:05 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV42647%27 HTTP/1.1" 200 None
2026-03-28 05:37:05 [auto1.de] INFO: Scrape type for HV42647: 2
2026-03-28 05:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eea78b6-5474-50d9-b23d-35fabb4d034b with identifier: HV42647
2026-03-28 05:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eea78b6-5474-50d9-b23d-35fabb4d034b with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eea78b6-5474-50d9-b23d-35fabb4d034b with scrape type 2
2026-03-28 05:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eea78b6-5474-50d9-b23d-35fabb4d034b, identifier: HV42647
2026-03-28 05:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eea78b6-5474-50d9-b23d-35fabb4d034b with identifier: HV42647
2026-03-28 05:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eea78b6-5474-50d9-b23d-35fabb4d034b with identifier: HV42647
2026-03-28 05:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eea78b6-5474-50d9-b23d-35fabb4d034b with identifier: HV42647 to the API
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:32Z',
 'fuel_type': 'diesel',
 'id': '6eea78b6-5474-50d9-b23d-35fabb4d034b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV42647',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 353267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2016}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV42647%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Saving data for HV42647: {'auction_closing_time': 1774715072.0, 'created_time': 1774467810.559562, 'last_price_update_time': 1774676226.053942}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV42647') HTTP/1.1" 204 0
2026-03-28 05:37:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71017%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for WR71017: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG22521%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for JG22521: 2
2026-03-28 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with identifier: JG22521
2026-03-28 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3, identifier: JG22521
2026-03-28 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with identifier: JG22521
2026-03-28 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with identifier: JG22521
2026-03-28 05:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3 with identifier: JG22521 to the API
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:17Z',
 'fuel_type': 'diesel',
 'id': '205feb3e-81b3-5d1e-bad2-4a7a9f9f79b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG22521',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 147497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG22521%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Saving data for JG22521: {'auction_closing_time': 1774714877.0, 'created_time': 1774463953.094532, 'last_price_update_time': 1774676226.669934}
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG22521') HTTP/1.1" 204 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS66629%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for CS66629: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH58497%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for TH58497: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV43778%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for XV43778: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for FX01006: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE20823%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for LE20823: 0
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 05:37:06 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-28 05:37:06 [auto1.de] INFO: Scrape type for XU52502: 2
2026-03-28 05:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with identifier: XU52502
2026-03-28 05:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with scrape type 2
2026-03-28 05:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0, identifier: XU52502
2026-03-28 05:37:06 [scrapy.extensions.logstats] INFO: Crawled 63 pages (at 16 pages/min), scraped 134 items (at 81 items/min)
2026-03-28 05:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with identifier: XU52502
2026-03-28 05:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with identifier: XU52502
2026-03-28 05:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0 with identifier: XU52502 to the API
2026-03-28 05:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:47:00Z',
 'fuel_type': 'petrol',
 'id': '3ad3e150-4ab7-51a5-a7bd-f0a771dfa9b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU52502',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 134247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Saving data for XU52502: {'auction_closing_time': 1774716420.0, 'created_time': 1774553001.578379, 'last_price_update_time': 1774676227.200109}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU52502') HTTP/1.1" 204 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for WA42384: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for DW77915: 2
2026-03-28 05:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-28 05:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90797859-764f-57ff-aa1d-d47f233f6db6 with scrape type 2
2026-03-28 05:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90797859-764f-57ff-aa1d-d47f233f6db6 with scrape type 2
2026-03-28 05:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90797859-764f-57ff-aa1d-d47f233f6db6, identifier: DW77915
2026-03-28 05:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-28 05:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-28 05:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915 to the API
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:26:58Z',
 'fuel_type': 'hybrid',
 'id': '90797859-764f-57ff-aa1d-d47f233f6db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 24670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-05',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Saving data for DW77915: {'auction_closing_time': 1774715218.0, 'created_time': 1774552129.314913, 'last_price_update_time': 1774676227.768335}
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77915') HTTP/1.1" 204 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB51000%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for LB51000: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for MS83797: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26845%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for TF26845: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE20875%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for XE20875: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95422%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for HE95422: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL47412%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for FL47412: 0
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-28 05:37:07 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC82787%27 HTTP/1.1" 200 None
2026-03-28 05:37:07 [auto1.de] INFO: Scrape type for EC82787: 0
2026-03-28 05:37:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:09 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: AN49564
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN49564%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for AN49564: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73277%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for ZC73277: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL25481%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for FL25481: 0
2026-03-28 05:37:09 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-28 05:37:09 [auto1.de] INFO: Scrape type for BS60844: 2
2026-03-28 05:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-28 05:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with scrape type 2
2026-03-28 05:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with scrape type 2
2026-03-28 05:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93dd2b2c-9bf0-500b-a47c-23afdbf71807, identifier: BS60844
2026-03-28 05:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-28 05:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-28 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844 to the API
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:32Z',
 'fuel_type': 'diesel',
 'id': '93dd2b2c-9bf0-500b-a47c-23afdbf71807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS60844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 195738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Saving data for BS60844: {'auction_closing_time': 1774713872.0, 'created_time': 1774552539.942203, 'last_price_update_time': 1774676230.36131}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS60844') HTTP/1.1" 204 0
2026-03-28 05:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for XC67226: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Scrape type for HS09512: 2
2026-03-28 05:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-28 05:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8b0342-24e9-5f59-ba4c-387602982586 with scrape type 2
2026-03-28 05:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8b0342-24e9-5f59-ba4c-387602982586 with scrape type 2
2026-03-28 05:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd8b0342-24e9-5f59-ba4c-387602982586, identifier: HS09512
2026-03-28 05:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-28 05:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-28 05:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512 to the API
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:17:17Z',
 'fuel_type': 'petrol',
 'id': 'dd8b0342-24e9-5f59-ba4c-387602982586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS09512',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-28 05:37:10 [auto1.de] INFO: Saving data for HS09512: {'auction_closing_time': 1774714637.0, 'created_time': 1774552701.338276, 'last_price_update_time': 1774676230.969915}
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS09512') HTTP/1.1" 204 0
2026-03-28 05:37:10 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-28 05:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR15853%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for VR15853: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for UY94864: 2
2026-03-28 05:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-28 05:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937826b1-94fd-5328-8cbe-88960d13fa07 with scrape type 2
2026-03-28 05:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 937826b1-94fd-5328-8cbe-88960d13fa07 with scrape type 2
2026-03-28 05:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 937826b1-94fd-5328-8cbe-88960d13fa07, identifier: UY94864
2026-03-28 05:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-28 05:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864
2026-03-28 05:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 937826b1-94fd-5328-8cbe-88960d13fa07 with identifier: UY94864 to the API
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:58Z',
 'fuel_type': 'diesel',
 'id': '937826b1-94fd-5328-8cbe-88960d13fa07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY94864',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 154940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Saving data for UY94864: {'auction_closing_time': 1774714198.0, 'created_time': 1773380789.391841, 'last_price_update_time': 1774676231.451956}
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY94864') HTTP/1.1" 204 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP00177%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for AP00177: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98613%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for WN98613: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for MS42171: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS07550%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for GS07550: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU35652%27 HTTP/1.1" 200 None
2026-03-28 05:37:11 [auto1.de] INFO: Scrape type for WU35652: 0
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-28 05:37:11 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-28 05:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:13 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: NC47913
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD46198%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for KD46198: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71069%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for BM71069: 0
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-28 05:37:13 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-28 05:37:13 [auto1.de] INFO: Scrape type for EL67777: 2
2026-03-28 05:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-28 05:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742cf8ac-7faa-52da-b142-86b8cb0a3cae with scrape type 2
2026-03-28 05:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742cf8ac-7faa-52da-b142-86b8cb0a3cae with scrape type 2
2026-03-28 05:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 742cf8ac-7faa-52da-b142-86b8cb0a3cae, identifier: EL67777
2026-03-28 05:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-28 05:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-28 05:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777 to the API
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:25:56Z',
 'fuel_type': 'petrol',
 'id': '742cf8ac-7faa-52da-b142-86b8cb0a3cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL67777',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 77400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion Tech',
 'year': 2015}
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Saving data for EL67777: {'auction_closing_time': 1774715156.0, 'created_time': 1773946930.17414, 'last_price_update_time': 1774676234.292859}
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL67777') HTTP/1.1" 204 0
2026-03-28 05:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71247%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for MP71247: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72437%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for TS72437: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB41878%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for KB41878: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for EB09552: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95862%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for BA95862: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for XF39485: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for WZ32773: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for EX27277: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35623%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for HZ35623: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36949%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for AV36949: 0
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-28 05:37:14 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-28 05:37:14 [auto1.de] INFO: Scrape type for HC69827: 2
2026-03-28 05:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-28 05:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0733f327-d1f2-5b36-b532-3d930090460e with scrape type 2
2026-03-28 05:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0733f327-d1f2-5b36-b532-3d930090460e with scrape type 2
2026-03-28 05:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0733f327-d1f2-5b36-b532-3d930090460e, identifier: HC69827
2026-03-28 05:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-28 05:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-28 05:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827 to the API
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:29:10Z',
 'fuel_type': 'petrol',
 'id': '0733f327-d1f2-5b36-b532-3d930090460e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC69827',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 106325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Kizoku Intense',
 'transmission': 'manual',
 'trim': 'Kizoku Intense',
 'year': 2017}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-28 05:37:15 [auto1.de] INFO: Saving data for HC69827: {'auction_closing_time': 1774715350.0, 'created_time': 1774550626.6276, 'last_price_update_time': 1774676235.073398}
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC69827') HTTP/1.1" 204 0
2026-03-28 05:37:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:19 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for UK52286: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML58643%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for ML58643: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU25249%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for XU25249: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91521%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for NF91521: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97346%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for VR97346: 2
2026-03-28 05:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-03-28 05:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3f65a92-1674-5fa2-864a-e2653bb1897f with scrape type 2
2026-03-28 05:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3f65a92-1674-5fa2-864a-e2653bb1897f with scrape type 2
2026-03-28 05:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3f65a92-1674-5fa2-864a-e2653bb1897f, identifier: VR97346
2026-03-28 05:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-03-28 05:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346
2026-03-28 05:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3f65a92-1674-5fa2-864a-e2653bb1897f with identifier: VR97346 to the API
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:57Z',
 'fuel_type': 'diesel',
 'id': 'a3f65a92-1674-5fa2-864a-e2653bb1897f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR97346',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 180363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97346%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Saving data for VR97346: {'auction_closing_time': 1774714917.0, 'created_time': 1774463910.699505, 'last_price_update_time': 1774676239.687787}
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR97346') HTTP/1.1" 204 0
2026-03-28 05:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP67472%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for JP67472: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for YT31718: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: XJ09013
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-28 05:37:19 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-28 05:37:19 [auto1.de] INFO: Scrape type for EA13854: 2
2026-03-28 05:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fdf18e-5137-55df-b2c1-285329c506d2 with identifier: EA13854
2026-03-28 05:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fdf18e-5137-55df-b2c1-285329c506d2 with scrape type 2
2026-03-28 05:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39fdf18e-5137-55df-b2c1-285329c506d2 with scrape type 2
2026-03-28 05:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39fdf18e-5137-55df-b2c1-285329c506d2, identifier: EA13854
2026-03-28 05:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39fdf18e-5137-55df-b2c1-285329c506d2 with identifier: EA13854
2026-03-28 05:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39fdf18e-5137-55df-b2c1-285329c506d2 with identifier: EA13854
2026-03-28 05:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39fdf18e-5137-55df-b2c1-285329c506d2 with identifier: EA13854 to the API
2026-03-28 05:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:41:47Z',
 'fuel_type': 'diesel',
 'id': '39fdf18e-5137-55df-b2c1-285329c506d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA13854',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Crosser',
 'odometer': 256748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2011}
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Saving data for EA13854: {'auction_closing_time': 1774716107.0, 'created_time': 1774552635.936542, 'last_price_update_time': 1774676240.207422}
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA13854') HTTP/1.1" 204 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB71807%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for AB71807: 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW94912%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for CW94912: 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL98026%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for GL98026: 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ39772%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for GZ39772: 2
2026-03-28 05:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff159332-f89b-51c0-8dbd-b830bc7a6dab with identifier: GZ39772
2026-03-28 05:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff159332-f89b-51c0-8dbd-b830bc7a6dab with scrape type 2
2026-03-28 05:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff159332-f89b-51c0-8dbd-b830bc7a6dab with scrape type 2
2026-03-28 05:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff159332-f89b-51c0-8dbd-b830bc7a6dab, identifier: GZ39772
2026-03-28 05:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff159332-f89b-51c0-8dbd-b830bc7a6dab with identifier: GZ39772
2026-03-28 05:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff159332-f89b-51c0-8dbd-b830bc7a6dab with identifier: GZ39772
2026-03-28 05:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff159332-f89b-51c0-8dbd-b830bc7a6dab with identifier: GZ39772 to the API
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:35:14Z',
 'fuel_type': 'petrol',
 'id': 'ff159332-f89b-51c0-8dbd-b830bc7a6dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ39772',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 200504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ39772%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Saving data for GZ39772: {'auction_closing_time': 1774715714.0, 'created_time': 1774463917.265784, 'last_price_update_time': 1774676240.795179}
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ39772') HTTP/1.1" 204 0
2026-03-28 05:37:20 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-28 05:37:20 [auto1.de] INFO: Scrape type for TD61700: 2
2026-03-28 05:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-28 05:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3625a135-9961-5329-be46-23e7aaf9d138 with scrape type 2
2026-03-28 05:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3625a135-9961-5329-be46-23e7aaf9d138 with scrape type 2
2026-03-28 05:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3625a135-9961-5329-be46-23e7aaf9d138, identifier: TD61700
2026-03-28 05:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-28 05:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-28 05:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700 to the API
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:14:01Z',
 'fuel_type': 'diesel',
 'id': '3625a135-9961-5329-be46-23e7aaf9d138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD61700',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 206948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Saving data for TD61700: {'auction_closing_time': 1774714441.0, 'created_time': 1774550672.793424, 'last_price_update_time': 1774676241.360439}
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD61700') HTTP/1.1" 204 0
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Scrape type for CZ36938: 0
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Scrape type for RB04302: 2
2026-03-28 05:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-28 05:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f23027-c506-57e6-a388-db8cf67b4a79 with scrape type 2
2026-03-28 05:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3f23027-c506-57e6-a388-db8cf67b4a79 with scrape type 2
2026-03-28 05:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3f23027-c506-57e6-a388-db8cf67b4a79, identifier: RB04302
2026-03-28 05:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-28 05:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302
2026-03-28 05:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3f23027-c506-57e6-a388-db8cf67b4a79 with identifier: RB04302 to the API
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:10Z',
 'fuel_type': 'petrol',
 'id': 'd3f23027-c506-57e6-a388-db8cf67b4a79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB04302',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 142088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2014}
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Saving data for RB04302: {'auction_closing_time': 1774716970.0, 'created_time': 1773382574.283124, 'last_price_update_time': 1774676241.817027}
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB04302') HTTP/1.1" 204 0
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY53680%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Scrape type for DY53680: 0
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU08667%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Scrape type for XU08667: 0
2026-03-28 05:37:21 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-28 05:37:21 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-28 05:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:22 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA48340%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for RA48340: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS63097%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for GS63097: 0
2026-03-28 05:37:22 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-28 05:37:22 [auto1.de] INFO: Scrape type for AU85949: 2
2026-03-28 05:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with identifier: AU85949
2026-03-28 05:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with scrape type 2
2026-03-28 05:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc, identifier: AU85949
2026-03-28 05:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with identifier: AU85949
2026-03-28 05:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with identifier: AU85949
2026-03-28 05:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc with identifier: AU85949 to the API
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:19Z',
 'fuel_type': 'petrol',
 'id': '33a4d9c8-e3e5-5b84-ad28-02c6b9e94ddc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU85949',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 105083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Saving data for AU85949: {'auction_closing_time': 1774716439.0, 'created_time': 1774552715.319892, 'last_price_update_time': 1774676243.277582}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU85949') HTTP/1.1" 204 0
2026-03-28 05:37:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP70373%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for AP70373: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE18994%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for NE18994: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT90781%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for WT90781: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for UR14264: 2
2026-03-28 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-28 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f608519a-5619-5bf6-98f8-8d63dc615d0b with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f608519a-5619-5bf6-98f8-8d63dc615d0b with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f608519a-5619-5bf6-98f8-8d63dc615d0b, identifier: UR14264
2026-03-28 05:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-28 05:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-28 05:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264 to the API
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:50:01Z',
 'fuel_type': 'petrol',
 'id': 'f608519a-5619-5bf6-98f8-8d63dc615d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR14264',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 95614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2017}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Saving data for UR14264: {'auction_closing_time': 1774716601.0, 'created_time': 1774552924.887492, 'last_price_update_time': 1774676243.878364}
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR14264') HTTP/1.1" 204 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for RP43844: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for TW15848: 0
2026-03-28 05:37:23 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS91087%27 HTTP/1.1" 200 None
2026-03-28 05:37:23 [auto1.de] INFO: Scrape type for TS91087: 2
2026-03-28 05:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with identifier: TS91087
2026-03-28 05:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with scrape type 2
2026-03-28 05:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd, identifier: TS91087
2026-03-28 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with identifier: TS91087
2026-03-28 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with identifier: TS91087
2026-03-28 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1ed62c-5e65-5b7d-9706-d2bc326c01fd with identifier: TS91087 to the API
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:38Z',
 'fuel_type': 'diesel',
 'id': '4c1ed62c-5e65-5b7d-9706-d2bc326c01fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS91087',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 209596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-02',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2017}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS91087%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Saving data for TS91087: {'auction_closing_time': 1774713818.0, 'created_time': 1774467568.474613, 'last_price_update_time': 1774676244.358094}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS91087') HTTP/1.1" 204 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for FC74080: 2
2026-03-28 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-28 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983, identifier: FC74080
2026-03-28 05:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-28 05:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-28 05:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080 to the API
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:27:13Z',
 'fuel_type': 'petrol',
 'id': '1fe4356c-5f0e-56a1-8f4b-ad48c798f983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC74080',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '1007',
 'odometer': 98249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-31',
 'seller_name': None,
 'title': 'Peugeot 1007 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2006}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Saving data for FC74080: {'auction_closing_time': 1774715233.0, 'created_time': 1774552655.359772, 'last_price_update_time': 1774676244.871434}
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC74080') HTTP/1.1" 204 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52182%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for RZ52182: 0
2026-03-28 05:37:24 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-28 05:37:24 [auto1.de] INFO: Scrape type for FT31566: 2
2026-03-28 05:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-28 05:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with scrape type 2
2026-03-28 05:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b, identifier: FT31566
2026-03-28 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-28 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-28 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566 to the API
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:28:35Z',
 'fuel_type': 'petrol',
 'id': '2c3dcf3e-dd90-5c47-bbe7-026b1941582b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT31566',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 167153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2014}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Saving data for FT31566: {'auction_closing_time': 1774715315.0, 'created_time': 1774550714.589328, 'last_price_update_time': 1774676245.36468}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT31566') HTTP/1.1" 204 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU79813%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for LU79813: 2
2026-03-28 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3f0d82-4170-549f-8949-ae391e5fa58c with identifier: LU79813
2026-03-28 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3f0d82-4170-549f-8949-ae391e5fa58c with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3f0d82-4170-549f-8949-ae391e5fa58c with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea3f0d82-4170-549f-8949-ae391e5fa58c, identifier: LU79813
2026-03-28 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea3f0d82-4170-549f-8949-ae391e5fa58c with identifier: LU79813
2026-03-28 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea3f0d82-4170-549f-8949-ae391e5fa58c with identifier: LU79813
2026-03-28 05:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea3f0d82-4170-549f-8949-ae391e5fa58c with identifier: LU79813 to the API
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:30Z',
 'fuel_type': 'petrol',
 'id': 'ea3f0d82-4170-549f-8949-ae391e5fa58c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU79813',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 57047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'Audi A3 Limousine 35 TFSI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU79813%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Saving data for LU79813: {'auction_closing_time': 1774716030.0, 'created_time': 1774463874.692014, 'last_price_update_time': 1774676245.798068}
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU79813') HTTP/1.1" 204 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48400%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for NV48400: 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22945%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for RX22945: 0
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-28 05:37:25 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-28 05:37:25 [auto1.de] INFO: Scrape type for ST98775: 2
2026-03-28 05:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0801a302-f2a7-56fb-95ee-33bfd51b6acd with identifier: ST98775
2026-03-28 05:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0801a302-f2a7-56fb-95ee-33bfd51b6acd with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0801a302-f2a7-56fb-95ee-33bfd51b6acd with scrape type 2
2026-03-28 05:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0801a302-f2a7-56fb-95ee-33bfd51b6acd, identifier: ST98775
2026-03-28 05:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0801a302-f2a7-56fb-95ee-33bfd51b6acd with identifier: ST98775
2026-03-28 05:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0801a302-f2a7-56fb-95ee-33bfd51b6acd with identifier: ST98775
2026-03-28 05:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0801a302-f2a7-56fb-95ee-33bfd51b6acd with identifier: ST98775 to the API
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:44:46Z',
 'fuel_type': 'diesel',
 'id': '0801a302-f2a7-56fb-95ee-33bfd51b6acd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST98775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 247483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 SDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2009}
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Saving data for ST98775: {'auction_closing_time': 1774716286.0, 'created_time': 1774552993.295539, 'last_price_update_time': 1774676246.269659}
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST98775') HTTP/1.1" 204 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF93957%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for VF93957: 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW00282%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for EW00282: 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR69038%27 HTTP/1.1" 200 None
2026-03-28 05:37:26 [auto1.de] INFO: Scrape type for UR69038: 0
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 05:37:26 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-28 05:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:27 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for DW05211: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ84912%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for KZ84912: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF81636%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for CF81636: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD73586%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for GD73586: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA74860%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for FA74860: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV71441%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for RV71441: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR29926%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for PR29926: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV83779%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for BV83779: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for FA89686: 2
2026-03-28 05:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-28 05:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247476db-d9a4-5ee1-ab82-02c4be2bda40 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247476db-d9a4-5ee1-ab82-02c4be2bda40 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 247476db-d9a4-5ee1-ab82-02c4be2bda40, identifier: FA89686
2026-03-28 05:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-28 05:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686
2026-03-28 05:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 247476db-d9a4-5ee1-ab82-02c4be2bda40 with identifier: FA89686 to the API
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:52Z',
 'fuel_type': 'diesel',
 'id': '247476db-d9a4-5ee1-ab82-02c4be2bda40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA89686',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 203708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Saving data for FA89686: {'auction_closing_time': 1774714492.0, 'created_time': 1773225888.089096, 'last_price_update_time': 1774676247.580695}
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA89686') HTTP/1.1" 204 0
2026-03-28 05:37:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for KB32538: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ57576%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for MZ57576: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-28 05:37:27 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU90887%27 HTTP/1.1" 200 None
2026-03-28 05:37:27 [auto1.de] INFO: Scrape type for DU90887: 2
2026-03-28 05:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with identifier: DU90887
2026-03-28 05:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with scrape type 2
2026-03-28 05:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26bc5df4-2bfc-5ab5-8502-9b760f312ca4, identifier: DU90887
2026-03-28 05:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with identifier: DU90887
2026-03-28 05:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with identifier: DU90887
2026-03-28 05:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26bc5df4-2bfc-5ab5-8502-9b760f312ca4 with identifier: DU90887 to the API
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:30:13Z',
 'fuel_type': 'petrol',
 'id': '26bc5df4-2bfc-5ab5-8502-9b760f312ca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU90887',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 124560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU90887%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Saving data for DU90887: {'auction_closing_time': 1774715413.0, 'created_time': 1774466700.927649, 'last_price_update_time': 1774676248.239239}
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU90887') HTTP/1.1" 204 0
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB32533%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Scrape type for NB32533: 0
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR77482%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Scrape type for LR77482: 0
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Scrape type for NC83571: 0
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82889%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Scrape type for MA82889: 2
2026-03-28 05:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4550ae77-65c8-5f21-a799-1fd84f63e225 with identifier: MA82889
2026-03-28 05:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4550ae77-65c8-5f21-a799-1fd84f63e225 with scrape type 2
2026-03-28 05:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4550ae77-65c8-5f21-a799-1fd84f63e225 with scrape type 2
2026-03-28 05:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4550ae77-65c8-5f21-a799-1fd84f63e225, identifier: MA82889
2026-03-28 05:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4550ae77-65c8-5f21-a799-1fd84f63e225 with identifier: MA82889
2026-03-28 05:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4550ae77-65c8-5f21-a799-1fd84f63e225 with identifier: MA82889
2026-03-28 05:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4550ae77-65c8-5f21-a799-1fd84f63e225 with identifier: MA82889 to the API
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:30:29Z',
 'fuel_type': 'diesel',
 'id': '4550ae77-65c8-5f21-a799-1fd84f63e225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA82889',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 209298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-25',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82889%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Saving data for MA82889: {'auction_closing_time': 1774715429.0, 'created_time': 1773307185.228403, 'last_price_update_time': 1774676248.742435}
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA82889') HTTP/1.1" 204 0
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-28 05:37:28 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-28 05:37:28 [auto1.de] INFO: Scrape type for VN62534: 2
2026-03-28 05:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-28 05:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904988d9-40d8-53d8-aa97-b317f0ad570c with scrape type 2
2026-03-28 05:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904988d9-40d8-53d8-aa97-b317f0ad570c with scrape type 2
2026-03-28 05:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 904988d9-40d8-53d8-aa97-b317f0ad570c, identifier: VN62534
2026-03-28 05:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-28 05:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-28 05:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534 to the API
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-28T16:13:57Z',
 'fuel_type': 'diesel',
 'id': '904988d9-40d8-53d8-aa97-b317f0ad570c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN62534',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 82782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Saving data for VN62534: {'auction_closing_time': 1774714437.0, 'created_time': 1774552342.332474, 'last_price_update_time': 1774676249.257981}
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN62534') HTTP/1.1" 204 0
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA82480%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Scrape type for FA82480: 0
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Scrape type for ZR98160: 2
2026-03-28 05:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-28 05:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5afa1e3-9307-5a51-990c-3822930180ab with scrape type 2
2026-03-28 05:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5afa1e3-9307-5a51-990c-3822930180ab with scrape type 2
2026-03-28 05:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5afa1e3-9307-5a51-990c-3822930180ab, identifier: ZR98160
2026-03-28 05:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-28 05:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-28 05:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160 to the API
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:08:04Z',
 'fuel_type': 'diesel',
 'id': 'c5afa1e3-9307-5a51-990c-3822930180ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR98160',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 129590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Saving data for ZR98160: {'auction_closing_time': 1774714084.0, 'created_time': 1772547039.918525, 'last_price_update_time': 1774676249.75979}
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR98160') HTTP/1.1" 204 0
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72146%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Scrape type for TS72146: 0
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 05:37:29 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-28 05:37:29 [auto1.de] INFO: Scrape type for GL61912: 2
2026-03-28 05:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-28 05:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a570579f-d572-5307-9c0b-a960e9735e2c with scrape type 2
2026-03-28 05:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a570579f-d572-5307-9c0b-a960e9735e2c with scrape type 2
2026-03-28 05:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a570579f-d572-5307-9c0b-a960e9735e2c, identifier: GL61912
2026-03-28 05:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-28 05:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-28 05:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912 to the API
2026-03-28 05:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:09:28Z',
 'fuel_type': 'petrol',
 'id': 'a570579f-d572-5307-9c0b-a960e9735e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61912',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 38168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-05',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-28 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-28 05:37:30 [auto1.de] INFO: Saving data for GL61912: {'auction_closing_time': 1774714168.0, 'created_time': 1774552878.461978, 'last_price_update_time': 1774676250.212936}
2026-03-28 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL61912') HTTP/1.1" 204 0
2026-03-28 05:37:30 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-28 05:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:46 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS15243%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for XS15243: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD51082%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for SD51082: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for RS40485: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU27440%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for XU27440: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW69442%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for ZW69442: 2
2026-03-28 05:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2da668b-211c-566c-b090-6442b7948562 with identifier: ZW69442
2026-03-28 05:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2da668b-211c-566c-b090-6442b7948562 with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2da668b-211c-566c-b090-6442b7948562 with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2da668b-211c-566c-b090-6442b7948562, identifier: ZW69442
2026-03-28 05:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2da668b-211c-566c-b090-6442b7948562 with identifier: ZW69442
2026-03-28 05:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2da668b-211c-566c-b090-6442b7948562 with identifier: ZW69442
2026-03-28 05:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2da668b-211c-566c-b090-6442b7948562 with identifier: ZW69442 to the API
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:07:35Z',
 'fuel_type': 'hybrid',
 'id': 'd2da668b-211c-566c-b090-6442b7948562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW69442',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 168455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Hybrid4 RXH',
 'transmission': 'automatic',
 'trim': 'RXH',
 'year': 2015}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW69442%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Saving data for ZW69442: {'auction_closing_time': 1774714055.0, 'created_time': 1774553079.369451, 'last_price_update_time': 1774676266.630569}
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW69442') HTTP/1.1" 204 0
2026-03-28 05:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: XJ72982
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ72982%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for XJ72982: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX72474%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for LX72474: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU02651%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for VU02651: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-28 05:37:46 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-28 05:37:46 [auto1.de] INFO: Scrape type for DV89701: 2
2026-03-28 05:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-28 05:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c2877f-7fb0-5af8-954b-137f4469dde9 with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22c2877f-7fb0-5af8-954b-137f4469dde9 with scrape type 2
2026-03-28 05:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22c2877f-7fb0-5af8-954b-137f4469dde9, identifier: DV89701
2026-03-28 05:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-28 05:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-28 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701 to the API
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:32Z',
 'fuel_type': 'petrol',
 'id': '22c2877f-7fb0-5af8-954b-137f4469dde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV89701',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 112683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Saving data for DV89701: {'auction_closing_time': 1774715252.0, 'created_time': 1774552860.706624, 'last_price_update_time': 1774676267.248644}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV89701') HTTP/1.1" 204 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42305%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for ZS42305: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12246%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for NF12246: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW97378%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for LW97378: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for BW78905: 2
2026-03-28 05:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-28 05:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170ce003-a885-5931-91f2-6df474012271 with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170ce003-a885-5931-91f2-6df474012271 with scrape type 2
2026-03-28 05:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 170ce003-a885-5931-91f2-6df474012271, identifier: BW78905
2026-03-28 05:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-28 05:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-28 05:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905 to the API
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:34:56Z',
 'fuel_type': 'petrol',
 'id': '170ce003-a885-5931-91f2-6df474012271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW78905',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 87262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Cup Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Cup Sport & Style 4Motion',
 'year': 2014}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Saving data for BW78905: {'auction_closing_time': 1774715696.0, 'created_time': 1774552829.553897, 'last_price_update_time': 1774676267.748783}
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW78905') HTTP/1.1" 204 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT28781%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for LT28781: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for VJ57746: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP20797%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for NP20797: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-28 05:37:47 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-28 05:37:47 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-28 05:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:48 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX80468%27 HTTP/1.1" 200 None
2026-03-28 05:37:48 [auto1.de] INFO: Scrape type for VX80468: 0
2026-03-28 05:37:48 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-28 05:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF99231%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for LF99231: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for FN01227: 2
2026-03-28 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-28 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0950b97-e003-54b9-a4c7-968286e17e95 with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0950b97-e003-54b9-a4c7-968286e17e95 with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0950b97-e003-54b9-a4c7-968286e17e95, identifier: FN01227
2026-03-28 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-28 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-28 05:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227 to the API
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:58Z',
 'fuel_type': 'diesel',
 'id': 'd0950b97-e003-54b9-a4c7-968286e17e95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN01227',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 184158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Saving data for FN01227: {'auction_closing_time': 1774713838.0, 'created_time': 1774552602.798169, 'last_price_update_time': 1774676269.440024}
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN01227') HTTP/1.1" 204 0
2026-03-28 05:37:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH42279%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for YH42279: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP47374%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for UP47374: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS14610%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for PS14610: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for AH65486: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for AG84988: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD48131%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for SD48131: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89235%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for VH89235: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU81602%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for LU81602: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29704%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for RM29704: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF78416%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for DF78416: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for TU13190: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: NP44902
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE16674%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for UE16674: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for PF21402: 0
2026-03-28 05:37:49 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-28 05:37:49 [auto1.de] INFO: Scrape type for FJ09626: 2
2026-03-28 05:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-28 05:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260ac118-0df0-50fb-b1fe-c054fc938c1f with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260ac118-0df0-50fb-b1fe-c054fc938c1f with scrape type 2
2026-03-28 05:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 260ac118-0df0-50fb-b1fe-c054fc938c1f, identifier: FJ09626
2026-03-28 05:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-28 05:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-28 05:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626 to the API
2026-03-28 05:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:03:52Z',
 'fuel_type': 'petrol',
 'id': '260ac118-0df0-50fb-b1fe-c054fc938c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ09626',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 53076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2015}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-28 05:37:51 [auto1.de] INFO: Saving data for FJ09626: {'auction_closing_time': 1774713832.0, 'created_time': 1774553212.630963, 'last_price_update_time': 1774676271.160495}
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ09626') HTTP/1.1" 204 0
2026-03-28 05:37:51 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-28 05:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:52 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for VK80269: 0
2026-03-28 05:37:52 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-28 05:37:52 [auto1.de] INFO: Scrape type for HW43883: 2
2026-03-28 05:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-28 05:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c3f101-d167-5039-8a7c-c2a991e5a94d with scrape type 2
2026-03-28 05:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43c3f101-d167-5039-8a7c-c2a991e5a94d with scrape type 2
2026-03-28 05:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43c3f101-d167-5039-8a7c-c2a991e5a94d, identifier: HW43883
2026-03-28 05:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-28 05:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-28 05:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883 to the API
2026-03-28 05:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:13:00Z',
 'fuel_type': 'petrol',
 'id': '43c3f101-d167-5039-8a7c-c2a991e5a94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW43883',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 237445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-19',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2007}
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Saving data for HW43883: {'auction_closing_time': 1774714380.0, 'created_time': 1774552994.47203, 'last_price_update_time': 1774676273.675061}
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW43883') HTTP/1.1" 204 0
2026-03-28 05:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 05:37:53 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-28 05:37:53 [auto1.de] INFO: Scrape type for JX06129: 2
2026-03-28 05:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-28 05:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00df2826-9faa-59db-828b-5e77f937768d with scrape type 2
2026-03-28 05:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00df2826-9faa-59db-828b-5e77f937768d with scrape type 2
2026-03-28 05:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00df2826-9faa-59db-828b-5e77f937768d, identifier: JX06129
2026-03-28 05:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-28 05:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-28 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129 to the API
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:01:45Z',
 'fuel_type': 'petrol',
 'id': '00df2826-9faa-59db-828b-5e77f937768d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX06129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 211635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2008}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Saving data for JX06129: {'auction_closing_time': 1774713705.0, 'created_time': 1773307719.861102, 'last_price_update_time': 1774676274.270373}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX06129') HTTP/1.1" 204 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF23775%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for CF23775: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ59261%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for LJ59261: 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for EM14245: 2
2026-03-28 05:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-28 05:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3736c5f-15d3-5954-aba4-9c17c34225cd with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3736c5f-15d3-5954-aba4-9c17c34225cd with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3736c5f-15d3-5954-aba4-9c17c34225cd, identifier: EM14245
2026-03-28 05:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-28 05:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-28 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245 to the API
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:06:09Z',
 'fuel_type': 'petrol',
 'id': 'b3736c5f-15d3-5954-aba4-9c17c34225cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM14245',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 412826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-25',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Saving data for EM14245: {'auction_closing_time': 1774713969.0, 'created_time': 1774465730.583988, 'last_price_update_time': 1774676274.767123}
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM14245') HTTP/1.1" 204 0
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 05:37:54 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-28 05:37:54 [auto1.de] INFO: Scrape type for UY21095: 2
2026-03-28 05:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-28 05:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c3e73a-523d-5352-8771-b501c4774348 with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c3e73a-523d-5352-8771-b501c4774348 with scrape type 2
2026-03-28 05:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9c3e73a-523d-5352-8771-b501c4774348, identifier: UY21095
2026-03-28 05:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-28 05:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-28 05:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095 to the API
2026-03-28 05:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:14:24Z',
 'fuel_type': 'diesel',
 'id': 'e9c3e73a-523d-5352-8771-b501c4774348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY21095',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 217312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Opel Vectra 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2008}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Saving data for UY21095: {'auction_closing_time': 1774714464.0, 'created_time': 1774553240.415543, 'last_price_update_time': 1774676276.197339}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY21095') HTTP/1.1" 204 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK10359%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for UK10359: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX46872%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for HX46872: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE17947%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for DE17947: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for XN65057: 2
2026-03-28 05:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-28 05:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with scrape type 2
2026-03-28 05:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with scrape type 2
2026-03-28 05:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6, identifier: XN65057
2026-03-28 05:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-28 05:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-28 05:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057 to the API
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:05:56Z',
 'fuel_type': 'diesel',
 'id': '885c24c4-bb32-57f9-8cbd-7aa8d88e19a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN65057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 128776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Saving data for XN65057: {'auction_closing_time': 1774713956.0, 'created_time': 1774553136.172931, 'last_price_update_time': 1774676276.883529}
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN65057') HTTP/1.1" 204 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07323%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for RW07323: 0
2026-03-28 05:37:56 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-28 05:37:56 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-28 05:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:37:58 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9199 | hits on page: 40
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93304%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for AE93304: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for KD53590: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for YR25980: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS40784%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for DS40784: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE28687%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for NE28687: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for KU48054: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27064%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for DM27064: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92075%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for MV92075: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM96313%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for JM96313: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX25395%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for UX25395: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS81057%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for AS81057: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for XA15787: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75828%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for LS75828: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX05955%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for NX05955: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for VJ43142: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN21474%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for KN21474: 0
2026-03-28 05:37:58 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL05657%27 HTTP/1.1" 200 None
2026-03-28 05:37:58 [auto1.de] INFO: Scrape type for ZL05657: 2
2026-03-28 05:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 415568be-3749-55af-a9cd-b41626cff082 with identifier: ZL05657
2026-03-28 05:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 415568be-3749-55af-a9cd-b41626cff082 with scrape type 2
2026-03-28 05:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 415568be-3749-55af-a9cd-b41626cff082 with scrape type 2
2026-03-28 05:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 415568be-3749-55af-a9cd-b41626cff082, identifier: ZL05657
2026-03-28 05:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 415568be-3749-55af-a9cd-b41626cff082 with identifier: ZL05657
2026-03-28 05:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 415568be-3749-55af-a9cd-b41626cff082 with identifier: ZL05657
2026-03-28 05:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 415568be-3749-55af-a9cd-b41626cff082 with identifier: ZL05657 to the API
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:20:51Z',
 'fuel_type': 'petrol',
 'id': '415568be-3749-55af-a9cd-b41626cff082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL05657',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 130556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL05657%27 HTTP/1.1" 200 None
2026-03-28 05:37:59 [auto1.de] INFO: Saving data for ZL05657: {'auction_closing_time': 1774714851.0, 'created_time': 1774550901.224289, 'last_price_update_time': 1774676279.818023}
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL05657') HTTP/1.1" 204 0
2026-03-28 05:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:37:59 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-28 05:37:59 [auto1.de] INFO: Scrape type for BX19940: 0
2026-03-28 05:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:00 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: MA14721
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH51203%27 HTTP/1.1" 200 None
2026-03-28 05:38:00 [auto1.de] INFO: Scrape type for YH51203: 0
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR19710%27 HTTP/1.1" 200 None
2026-03-28 05:38:00 [auto1.de] INFO: Scrape type for VR19710: 0
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-28 05:38:00 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-28 05:38:00 [auto1.de] INFO: Scrape type for SX22441: 2
2026-03-28 05:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-28 05:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1753a845-8731-58cd-b692-97baae793e3f with scrape type 2
2026-03-28 05:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1753a845-8731-58cd-b692-97baae793e3f with scrape type 2
2026-03-28 05:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1753a845-8731-58cd-b692-97baae793e3f, identifier: SX22441
2026-03-28 05:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-28 05:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-28 05:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441 to the API
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'diesel',
 'id': '1753a845-8731-58cd-b692-97baae793e3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX22441',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 227520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-31',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Saving data for SX22441: {'auction_closing_time': 1774714816.0, 'created_time': 1774550732.71703, 'last_price_update_time': 1774676281.383923}
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX22441') HTTP/1.1" 204 0
2026-03-28 05:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL76600%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for VL76600: 2
2026-03-28 05:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e5a522-0453-5695-a1de-14b7aa4380b5 with identifier: VL76600
2026-03-28 05:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e5a522-0453-5695-a1de-14b7aa4380b5 with scrape type 2
2026-03-28 05:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e5a522-0453-5695-a1de-14b7aa4380b5 with scrape type 2
2026-03-28 05:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7e5a522-0453-5695-a1de-14b7aa4380b5, identifier: VL76600
2026-03-28 05:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7e5a522-0453-5695-a1de-14b7aa4380b5 with identifier: VL76600
2026-03-28 05:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7e5a522-0453-5695-a1de-14b7aa4380b5 with identifier: VL76600
2026-03-28 05:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7e5a522-0453-5695-a1de-14b7aa4380b5 with identifier: VL76600 to the API
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:14Z',
 'fuel_type': 'diesel',
 'id': 'd7e5a522-0453-5695-a1de-14b7aa4380b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL76600',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 128019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL76600%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Saving data for VL76600: {'auction_closing_time': 1774715834.0, 'created_time': 1774468026.4631, 'last_price_update_time': 1774676281.929467}
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL76600') HTTP/1.1" 204 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB19367%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for LB19367: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-28 05:38:01 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-28 05:38:01 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-28 05:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM18653%27 HTTP/1.1" 200 None
2026-03-28 05:38:02 [auto1.de] INFO: Scrape type for ZM18653: 0
2026-03-28 05:38:02 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 05:38:02 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 05:38:02 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-28 05:38:02 [auto1.de] INFO: Scrape type for WV85362: 2
2026-03-28 05:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-28 05:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb98296-79ed-56ba-9b48-d14e245e6ce0 with scrape type 2
2026-03-28 05:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb98296-79ed-56ba-9b48-d14e245e6ce0 with scrape type 2
2026-03-28 05:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb98296-79ed-56ba-9b48-d14e245e6ce0, identifier: WV85362
2026-03-28 05:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-28 05:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-28 05:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362 to the API
2026-03-28 05:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:34Z',
 'fuel_type': 'petrol',
 'id': 'dfb98296-79ed-56ba-9b48-d14e245e6ce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV85362',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-22',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Saving data for WV85362: {'auction_closing_time': 1774714534.0, 'created_time': 1774552571.712892, 'last_price_update_time': 1774676283.213729}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV85362') HTTP/1.1" 204 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR24892%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for MR24892: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL40189%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for KL40189: 2
2026-03-28 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba6e1ce-8ca0-550c-898a-8e7ecf72699c with identifier: KL40189
2026-03-28 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba6e1ce-8ca0-550c-898a-8e7ecf72699c with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba6e1ce-8ca0-550c-898a-8e7ecf72699c with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba6e1ce-8ca0-550c-898a-8e7ecf72699c, identifier: KL40189
2026-03-28 05:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba6e1ce-8ca0-550c-898a-8e7ecf72699c with identifier: KL40189
2026-03-28 05:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba6e1ce-8ca0-550c-898a-8e7ecf72699c with identifier: KL40189
2026-03-28 05:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba6e1ce-8ca0-550c-898a-8e7ecf72699c with identifier: KL40189 to the API
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:07:27Z',
 'fuel_type': 'petrol',
 'id': 'cba6e1ce-8ca0-550c-898a-8e7ecf72699c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL40189',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 146399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL40189%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Saving data for KL40189: {'auction_closing_time': 1774714047.0, 'created_time': 1774463872.402693, 'last_price_update_time': 1774676283.803536}
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL40189') HTTP/1.1" 204 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66986%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for LL66986: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD68347%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for UD68347: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV75599%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for GV75599: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for AN60754: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT66272%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for YT66272: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK96538%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for MK96538: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB03654%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for DB03654: 0
2026-03-28 05:38:03 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-28 05:38:03 [auto1.de] INFO: Scrape type for HN24396: 2
2026-03-28 05:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-28 05:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 2
2026-03-28 05:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 2
2026-03-28 05:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79081c0b-3212-5214-9001-bae5c3b59581, identifier: HN24396
2026-03-28 05:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-28 05:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-28 05:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396 to the API
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:20:44Z',
 'fuel_type': 'petrol',
 'id': '79081c0b-3212-5214-9001-bae5c3b59581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN24396',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 40182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-18',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2009}
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Saving data for HN24396: {'auction_closing_time': 1774714844.0, 'created_time': 1773917498.774471, 'last_price_update_time': 1774676284.415656}
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN24396') HTTP/1.1" 204 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31519%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for KL31519: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for DE25074: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU14902%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for RU14902: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for LJ39551: 0
2026-03-28 05:38:04 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-28 05:38:04 [auto1.de] INFO: Scrape type for FL34122: 0
2026-03-28 05:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:05 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX16022%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for RX16022: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT74468%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for YT74468: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for VX90434: 2
2026-03-28 05:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b56db40c-0da7-5de0-86f3-bbb07e843294 with identifier: VX90434
2026-03-28 05:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56db40c-0da7-5de0-86f3-bbb07e843294 with scrape type 2
2026-03-28 05:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b56db40c-0da7-5de0-86f3-bbb07e843294 with scrape type 2
2026-03-28 05:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b56db40c-0da7-5de0-86f3-bbb07e843294, identifier: VX90434
2026-03-28 05:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b56db40c-0da7-5de0-86f3-bbb07e843294 with identifier: VX90434
2026-03-28 05:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b56db40c-0da7-5de0-86f3-bbb07e843294 with identifier: VX90434
2026-03-28 05:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b56db40c-0da7-5de0-86f3-bbb07e843294 with identifier: VX90434 to the API
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:37Z',
 'fuel_type': 'diesel',
 'id': 'b56db40c-0da7-5de0-86f3-bbb07e843294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX90434',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 199052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2014}
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Saving data for VX90434: {'auction_closing_time': 1774716157.0, 'created_time': 1774550603.910775, 'last_price_update_time': 1774676285.7853}
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX90434') HTTP/1.1" 204 0
2026-03-28 05:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV23695%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for XV23695: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: LM46522
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA32583%27 HTTP/1.1" 200 None
2026-03-28 05:38:05 [auto1.de] INFO: Scrape type for KA32583: 0
2026-03-28 05:38:05 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 05:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for BX26482: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE96502%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for YE96502: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW02435%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for ZW02435: 2
2026-03-28 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9056f89a-03eb-5004-8fc4-9afad70536b9 with identifier: ZW02435
2026-03-28 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9056f89a-03eb-5004-8fc4-9afad70536b9 with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9056f89a-03eb-5004-8fc4-9afad70536b9 with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9056f89a-03eb-5004-8fc4-9afad70536b9, identifier: ZW02435
2026-03-28 05:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9056f89a-03eb-5004-8fc4-9afad70536b9 with identifier: ZW02435
2026-03-28 05:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9056f89a-03eb-5004-8fc4-9afad70536b9 with identifier: ZW02435
2026-03-28 05:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9056f89a-03eb-5004-8fc4-9afad70536b9 with identifier: ZW02435 to the API
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:58:07Z',
 'fuel_type': 'diesel',
 'id': '9056f89a-03eb-5004-8fc4-9afad70536b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW02435',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 127666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
 'transmission': 'manual',
 'trim': 'Spirit 4WD',
 'year': 2016}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW02435%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Saving data for ZW02435: {'auction_closing_time': 1774717087.0, 'created_time': 1774466540.707015, 'last_price_update_time': 1774676286.45436}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW02435') HTTP/1.1" 204 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43152%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for CS43152: 2
2026-03-28 05:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8022cdc2-b034-505a-ad85-3144b685d697 with identifier: CS43152
2026-03-28 05:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8022cdc2-b034-505a-ad85-3144b685d697 with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8022cdc2-b034-505a-ad85-3144b685d697 with scrape type 2
2026-03-28 05:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8022cdc2-b034-505a-ad85-3144b685d697, identifier: CS43152
2026-03-28 05:38:06 [scrapy.extensions.logstats] INFO: Crawled 74 pages (at 11 pages/min), scraped 177 items (at 43 items/min)
2026-03-28 05:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8022cdc2-b034-505a-ad85-3144b685d697 with identifier: CS43152
2026-03-28 05:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8022cdc2-b034-505a-ad85-3144b685d697 with identifier: CS43152
2026-03-28 05:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8022cdc2-b034-505a-ad85-3144b685d697 with identifier: CS43152 to the API
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:43Z',
 'fuel_type': 'diesel',
 'id': '8022cdc2-b034-505a-ad85-3144b685d697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS43152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 267391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2017}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43152%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Saving data for CS43152: {'auction_closing_time': 1774715443.0, 'created_time': 1773946546.148267, 'last_price_update_time': 1774676286.9518}
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS43152') HTTP/1.1" 204 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-28 05:38:06 [auto1.de] INFO: Scrape type for SD32112: 0
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 05:38:06 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-28 05:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF53186%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for JF53186: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU82641%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for CU82641: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG19353%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for AG19353: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: CL78510
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL78510%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for CL78510: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85811%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for FN85811: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR50455%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for TR50455: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK78478%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for JK78478: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX06422%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for NX06422: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY41560%27 HTTP/1.1" 200 None
2026-03-28 05:38:07 [auto1.de] INFO: Scrape type for BY41560: 0
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 05:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:07 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:07 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-28 05:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR54336%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for MR54336: 0
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for CL40632: 2
2026-03-28 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-28 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7b9001-669a-5b1a-8851-f10126d4cf09 with scrape type 2
2026-03-28 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7b9001-669a-5b1a-8851-f10126d4cf09 with scrape type 2
2026-03-28 05:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b7b9001-669a-5b1a-8851-f10126d4cf09, identifier: CL40632
2026-03-28 05:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-28 05:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-28 05:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632 to the API
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:22:47Z',
 'fuel_type': 'petrol',
 'id': '7b7b9001-669a-5b1a-8851-f10126d4cf09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL40632',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 130952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Saving data for CL40632: {'auction_closing_time': 1774714967.0, 'created_time': 1773228306.765338, 'last_price_update_time': 1774676288.458258}
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL40632') HTTP/1.1" 204 0
2026-03-28 05:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-28 05:38:08 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95910%27 HTTP/1.1" 200 None
2026-03-28 05:38:08 [auto1.de] INFO: Scrape type for PB95910: 2
2026-03-28 05:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b433344-64f9-5e35-95fd-65e902a09392 with identifier: PB95910
2026-03-28 05:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b433344-64f9-5e35-95fd-65e902a09392 with scrape type 2
2026-03-28 05:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b433344-64f9-5e35-95fd-65e902a09392 with scrape type 2
2026-03-28 05:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b433344-64f9-5e35-95fd-65e902a09392, identifier: PB95910
2026-03-28 05:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b433344-64f9-5e35-95fd-65e902a09392 with identifier: PB95910
2026-03-28 05:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b433344-64f9-5e35-95fd-65e902a09392 with identifier: PB95910
2026-03-28 05:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b433344-64f9-5e35-95fd-65e902a09392 with identifier: PB95910 to the API
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:17:08Z',
 'fuel_type': 'petrol',
 'id': '9b433344-64f9-5e35-95fd-65e902a09392',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB95910',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 183694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 230 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2008}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95910%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Saving data for PB95910: {'auction_closing_time': 1774714628.0, 'created_time': 1774466304.044063, 'last_price_update_time': 1774676289.028378}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB95910') HTTP/1.1" 204 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ24873%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for YJ24873: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP99471%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for AP99471: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG02615%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for PG02615: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR30275%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for VR30275: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30082%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for GC30082: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK62932%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for SK62932: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM74248%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for BM74248: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for WU59517: 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for WH84573: 2
2026-03-28 05:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-28 05:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7396db51-990a-57e8-8e7a-5c56954c2273 with scrape type 2
2026-03-28 05:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7396db51-990a-57e8-8e7a-5c56954c2273 with scrape type 2
2026-03-28 05:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7396db51-990a-57e8-8e7a-5c56954c2273, identifier: WH84573
2026-03-28 05:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-28 05:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-28 05:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573 to the API
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:32:00Z',
 'fuel_type': 'petrol',
 'id': '7396db51-990a-57e8-8e7a-5c56954c2273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH84573',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 248199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Saving data for WH84573: {'auction_closing_time': 1774715520.0, 'created_time': 1774551120.107952, 'last_price_update_time': 1774676289.671579}
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH84573') HTTP/1.1" 204 0
2026-03-28 05:38:09 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89138%27 HTTP/1.1" 200 None
2026-03-28 05:38:09 [auto1.de] INFO: Scrape type for SR89138: 2
2026-03-28 05:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8398095c-f890-5a88-b3bd-c2714769c230 with identifier: SR89138
2026-03-28 05:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8398095c-f890-5a88-b3bd-c2714769c230 with scrape type 2
2026-03-28 05:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8398095c-f890-5a88-b3bd-c2714769c230 with scrape type 2
2026-03-28 05:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8398095c-f890-5a88-b3bd-c2714769c230, identifier: SR89138
2026-03-28 05:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8398095c-f890-5a88-b3bd-c2714769c230 with identifier: SR89138
2026-03-28 05:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8398095c-f890-5a88-b3bd-c2714769c230 with identifier: SR89138
2026-03-28 05:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8398095c-f890-5a88-b3bd-c2714769c230 with identifier: SR89138 to the API
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:03:09Z',
 'fuel_type': 'petrol',
 'id': '8398095c-f890-5a88-b3bd-c2714769c230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR89138',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 87389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-23',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2012}
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89138%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Saving data for SR89138: {'auction_closing_time': 1774713789.0, 'created_time': 1773307427.553867, 'last_price_update_time': 1774676290.256129}
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR89138') HTTP/1.1" 204 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for WA89012: 2
2026-03-28 05:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-28 05:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8164d876-1647-548b-a032-1ae40db9998c with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8164d876-1647-548b-a032-1ae40db9998c with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8164d876-1647-548b-a032-1ae40db9998c, identifier: WA89012
2026-03-28 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-28 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-28 05:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012 to the API
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 600,
 'expiration_date': '2026-03-28T16:46:27Z',
 'fuel_type': 'petrol',
 'id': '8164d876-1647-548b-a032-1ae40db9998c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA89012',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 118024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'BMW 5er M5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Saving data for WA89012: {'auction_closing_time': 1774716387.0, 'created_time': 1774550584.448565, 'last_price_update_time': 1774676290.752261}
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA89012') HTTP/1.1" 204 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM30050%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for JM30050: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ89630%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for CJ89630: 0
2026-03-28 05:38:10 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-28 05:38:10 [auto1.de] INFO: Scrape type for AM64478: 2
2026-03-28 05:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73e4c97a-8e0f-5707-8a6d-2249db675fde with identifier: AM64478
2026-03-28 05:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73e4c97a-8e0f-5707-8a6d-2249db675fde with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73e4c97a-8e0f-5707-8a6d-2249db675fde with scrape type 2
2026-03-28 05:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73e4c97a-8e0f-5707-8a6d-2249db675fde, identifier: AM64478
2026-03-28 05:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73e4c97a-8e0f-5707-8a6d-2249db675fde with identifier: AM64478
2026-03-28 05:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73e4c97a-8e0f-5707-8a6d-2249db675fde with identifier: AM64478
2026-03-28 05:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73e4c97a-8e0f-5707-8a6d-2249db675fde with identifier: AM64478 to the API
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:06Z',
 'fuel_type': 'diesel',
 'id': '73e4c97a-8e0f-5707-8a6d-2249db675fde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM64478',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 52376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Saving data for AM64478: {'auction_closing_time': 1774716066.0, 'created_time': 1774553236.413434, 'last_price_update_time': 1774676291.264902}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM64478') HTTP/1.1" 204 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY96813%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for MY96813: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for UZ04747: 2
2026-03-28 05:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-28 05:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with scrape type 2
2026-03-28 05:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with scrape type 2
2026-03-28 05:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70, identifier: UZ04747
2026-03-28 05:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-28 05:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-28 05:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747 to the API
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:45:38Z',
 'fuel_type': 'diesel',
 'id': '33c8ac28-1323-5291-a5e4-a3bc2d9a2e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ04747',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 182584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Design Edition',
 'transmission': 'automatic',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Saving data for UZ04747: {'auction_closing_time': 1774716338.0, 'created_time': 1774552708.350387, 'last_price_update_time': 1774676291.751873}
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ04747') HTTP/1.1" 204 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for CW72943: 0
2026-03-28 05:38:11 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84563%27 HTTP/1.1" 200 None
2026-03-28 05:38:11 [auto1.de] INFO: Scrape type for KC84563: 2
2026-03-28 05:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0991b002-f0c9-5895-84ec-aee8f0ac9543 with identifier: KC84563
2026-03-28 05:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0991b002-f0c9-5895-84ec-aee8f0ac9543 with scrape type 2
2026-03-28 05:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0991b002-f0c9-5895-84ec-aee8f0ac9543 with scrape type 2
2026-03-28 05:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0991b002-f0c9-5895-84ec-aee8f0ac9543, identifier: KC84563
2026-03-28 05:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0991b002-f0c9-5895-84ec-aee8f0ac9543 with identifier: KC84563
2026-03-28 05:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0991b002-f0c9-5895-84ec-aee8f0ac9543 with identifier: KC84563
2026-03-28 05:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0991b002-f0c9-5895-84ec-aee8f0ac9543 with identifier: KC84563 to the API
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:38:57Z',
 'fuel_type': 'diesel',
 'id': '0991b002-f0c9-5895-84ec-aee8f0ac9543',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC84563',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 241634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84563%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Saving data for KC84563: {'auction_closing_time': 1774715937.0, 'created_time': 1774466617.973666, 'last_price_update_time': 1774676292.306562}
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC84563') HTTP/1.1" 204 0
2026-03-28 05:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:12 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA53800%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for RA53800: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT16474%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for KT16474: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE45288%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for GE45288: 0
2026-03-28 05:38:12 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Scrape type for HU68423: 2
2026-03-28 05:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-28 05:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151e62f5-794d-52db-ac20-aa24539d1514 with scrape type 2
2026-03-28 05:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151e62f5-794d-52db-ac20-aa24539d1514 with scrape type 2
2026-03-28 05:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151e62f5-794d-52db-ac20-aa24539d1514, identifier: HU68423
2026-03-28 05:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-28 05:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-28 05:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423 to the API
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:15Z',
 'fuel_type': 'diesel',
 'id': '151e62f5-794d-52db-ac20-aa24539d1514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU68423',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 171176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Elegance Plus Edition',
 'transmission': 'manual',
 'trim': 'Elegance Plus Edition',
 'year': 2014}
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-28 05:38:12 [auto1.de] INFO: Saving data for HU68423: {'auction_closing_time': 1774714215.0, 'created_time': 1774550961.878984, 'last_price_update_time': 1774676292.953616}
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU68423') HTTP/1.1" 204 0
2026-03-28 05:38:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for PP17491: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for KG76209: 2
2026-03-28 05:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-28 05:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29a8cad-be5d-56ff-823e-87447e7d7f9a with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29a8cad-be5d-56ff-823e-87447e7d7f9a with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d29a8cad-be5d-56ff-823e-87447e7d7f9a, identifier: KG76209
2026-03-28 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-28 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-28 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209 to the API
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:18:36Z',
 'fuel_type': 'diesel',
 'id': 'd29a8cad-be5d-56ff-823e-87447e7d7f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG76209',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 108692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Saving data for KG76209: {'auction_closing_time': 1774714716.0, 'created_time': 1774552974.631876, 'last_price_update_time': 1774676293.5675}
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG76209') HTTP/1.1" 204 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: LD43960
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD43960%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for LD43960: 0
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 05:38:13 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-28 05:38:13 [auto1.de] INFO: Scrape type for KH49369: 2
2026-03-28 05:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-28 05:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecca9cb0-03df-5b30-bd33-299a6c96eb56 with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecca9cb0-03df-5b30-bd33-299a6c96eb56 with scrape type 2
2026-03-28 05:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecca9cb0-03df-5b30-bd33-299a6c96eb56, identifier: KH49369
2026-03-28 05:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-28 05:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-28 05:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369 to the API
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:16:10Z',
 'fuel_type': 'petrol',
 'id': 'ecca9cb0-03df-5b30-bd33-299a6c96eb56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH49369',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 80764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2019}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Saving data for KH49369: {'auction_closing_time': 1774714570.0, 'created_time': 1774552875.162266, 'last_price_update_time': 1774676294.045065}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH49369') HTTP/1.1" 204 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB79259%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for DB79259: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA76856%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for GA76856: 2
2026-03-28 05:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with identifier: GA76856
2026-03-28 05:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with scrape type 2
2026-03-28 05:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6, identifier: GA76856
2026-03-28 05:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with identifier: GA76856
2026-03-28 05:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with identifier: GA76856
2026-03-28 05:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bb9ffac-dcac-5451-b2fa-ed9b51d373b6 with identifier: GA76856 to the API
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:49:27Z',
 'fuel_type': 'diesel',
 'id': '3bb9ffac-dcac-5451-b2fa-ed9b51d373b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA76856',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 194423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA76856%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Saving data for GA76856: {'auction_closing_time': 1774716567.0, 'created_time': 1774503334.825876, 'last_price_update_time': 1774676294.502885}
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA76856') HTTP/1.1" 204 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ06018%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for KZ06018: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC81158%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for LC81158: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for RD90003: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY77073%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for VY77073: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29969%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for ZK29969: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC50732%27 HTTP/1.1" 200 None
2026-03-28 05:38:14 [auto1.de] INFO: Scrape type for SC50732: 0
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 05:38:14 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 05:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:15 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 05:38:15 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-28 05:38:15 [auto1.de] INFO: Scrape type for AV13612: 2
2026-03-28 05:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5649e5bf-b98f-5cec-97ea-523d7f39d342 with identifier: AV13612
2026-03-28 05:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5649e5bf-b98f-5cec-97ea-523d7f39d342 with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5649e5bf-b98f-5cec-97ea-523d7f39d342 with scrape type 2
2026-03-28 05:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5649e5bf-b98f-5cec-97ea-523d7f39d342, identifier: AV13612
2026-03-28 05:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5649e5bf-b98f-5cec-97ea-523d7f39d342 with identifier: AV13612
2026-03-28 05:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5649e5bf-b98f-5cec-97ea-523d7f39d342 with identifier: AV13612
2026-03-28 05:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5649e5bf-b98f-5cec-97ea-523d7f39d342 with identifier: AV13612 to the API
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:42:19Z',
 'fuel_type': 'petrol',
 'id': '5649e5bf-b98f-5cec-97ea-523d7f39d342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV13612',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 81841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-04',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Saving data for AV13612: {'auction_closing_time': 1774716139.0, 'created_time': 1774552926.18352, 'last_price_update_time': 1774676296.249192}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV13612') HTTP/1.1" 204 0
2026-03-28 05:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19080%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for KR19080: 2
2026-03-28 05:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with identifier: KR19080
2026-03-28 05:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with scrape type 2
2026-03-28 05:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with scrape type 2
2026-03-28 05:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1f380e-4b53-5ab4-bd4c-332903bc91d0, identifier: KR19080
2026-03-28 05:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with identifier: KR19080
2026-03-28 05:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with identifier: KR19080
2026-03-28 05:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1f380e-4b53-5ab4-bd4c-332903bc91d0 with identifier: KR19080 to the API
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:42:34Z',
 'fuel_type': 'diesel',
 'id': 'ce1f380e-4b53-5ab4-bd4c-332903bc91d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR19080',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 126916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2016}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19080%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Saving data for KR19080: {'auction_closing_time': 1774716154.0, 'created_time': 1773303223.356685, 'last_price_update_time': 1774676296.806326}
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR19080') HTTP/1.1" 204 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for KA14077: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM15369%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for KM15369: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ71829%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for NZ71829: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX52841%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for YX52841: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for KF79768: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW04202%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for AW04202: 0
2026-03-28 05:38:16 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS62630%27 HTTP/1.1" 200 None
2026-03-28 05:38:16 [auto1.de] INFO: Scrape type for LS62630: 2
2026-03-28 05:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with identifier: LS62630
2026-03-28 05:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with scrape type 2
2026-03-28 05:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with scrape type 2
2026-03-28 05:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c867d97-d71b-5c5b-afb3-0f07e6352f04, identifier: LS62630
2026-03-28 05:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with identifier: LS62630
2026-03-28 05:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with identifier: LS62630
2026-03-28 05:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c867d97-d71b-5c5b-afb3-0f07e6352f04 with identifier: LS62630 to the API
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:06:57Z',
 'fuel_type': 'petrol',
 'id': '1c867d97-d71b-5c5b-afb3-0f07e6352f04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS62630',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 61309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-28',
 'seller_name': None,
 'title': 'Honda Civic 1.4 DSi Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2006}
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS62630%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Saving data for LS62630: {'auction_closing_time': 1774714017.0, 'created_time': 1774466151.152108, 'last_price_update_time': 1774676297.412216}
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS62630') HTTP/1.1" 204 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75435%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for HD75435: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: BG54710
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK63444%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for ZK63444: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for VZ53815: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16739%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for KZ16739: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE36911%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for EE36911: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS03319%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for SS03319: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-28 05:38:17 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-28 05:38:17 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-28 05:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:28 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44094%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for VX44094: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for AC92366: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for ZU01908: 0
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-28 05:38:28 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-28 05:38:28 [auto1.de] INFO: Scrape type for MZ37789: 2
2026-03-28 05:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-28 05:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7707c225-1567-57ce-a09c-d1d41625ae96 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7707c225-1567-57ce-a09c-d1d41625ae96 with scrape type 2
2026-03-28 05:38:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7707c225-1567-57ce-a09c-d1d41625ae96, identifier: MZ37789
2026-03-28 05:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-28 05:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-28 05:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789 to the API
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'petrol',
 'id': '7707c225-1567-57ce-a09c-d1d41625ae96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ37789',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 47176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2022}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Saving data for MZ37789: {'auction_closing_time': 1774714152.0, 'created_time': 1774552854.268498, 'last_price_update_time': 1774676309.0856}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ37789') HTTP/1.1" 204 0
2026-03-28 05:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER58682%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for ER58682: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV14435%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for CV14435: 2
2026-03-28 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 851316d5-9c5d-5bda-864f-f9045079bf1f with identifier: CV14435
2026-03-28 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 851316d5-9c5d-5bda-864f-f9045079bf1f with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 851316d5-9c5d-5bda-864f-f9045079bf1f with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 851316d5-9c5d-5bda-864f-f9045079bf1f, identifier: CV14435
2026-03-28 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 851316d5-9c5d-5bda-864f-f9045079bf1f with identifier: CV14435
2026-03-28 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 851316d5-9c5d-5bda-864f-f9045079bf1f with identifier: CV14435
2026-03-28 05:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 851316d5-9c5d-5bda-864f-f9045079bf1f with identifier: CV14435 to the API
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'petrol',
 'id': '851316d5-9c5d-5bda-864f-f9045079bf1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV14435',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 86276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-21',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV14435%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Saving data for CV14435: {'auction_closing_time': 1774716129.0, 'created_time': 1773307532.284924, 'last_price_update_time': 1774676309.680696}
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV14435') HTTP/1.1" 204 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ25882%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for BZ25882: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK13966%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for LK13966: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM70587%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for UM70587: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM02167%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for UM02167: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00358%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for SX00358: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT33295%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for FT33295: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for HC21911: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX96869%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for RX96869: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for KM84276: 0
2026-03-28 05:38:29 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-28 05:38:29 [auto1.de] INFO: Scrape type for PP83297: 2
2026-03-28 05:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-28 05:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with scrape type 2
2026-03-28 05:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701, identifier: PP83297
2026-03-28 05:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-28 05:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-28 05:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297 to the API
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': 'b3cd9b5d-1a54-55cc-984d-ee40ee8b0701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP83297',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 133302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2019}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Saving data for PP83297: {'auction_closing_time': 1774716663.0, 'created_time': 1774552910.607487, 'last_price_update_time': 1774676310.273439}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP83297') HTTP/1.1" 204 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for ZD70727: 2
2026-03-28 05:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-28 05:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fe22a5-c396-57f7-b7ba-14892afb6bfa with scrape type 2
2026-03-28 05:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4fe22a5-c396-57f7-b7ba-14892afb6bfa with scrape type 2
2026-03-28 05:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4fe22a5-c396-57f7-b7ba-14892afb6bfa, identifier: ZD70727
2026-03-28 05:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-28 05:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-28 05:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727 to the API
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:36:30Z',
 'fuel_type': 'petrol',
 'id': 'b4fe22a5-c396-57f7-b7ba-14892afb6bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD70727',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 83192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Saving data for ZD70727: {'auction_closing_time': 1774715790.0, 'created_time': 1774550666.193685, 'last_price_update_time': 1774676310.904017}
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD70727') HTTP/1.1" 204 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for YW60751: 0
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-28 05:38:30 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-28 05:38:30 [auto1.de] INFO: Scrape type for WR55651: 2
2026-03-28 05:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-28 05:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 538f7d47-b299-5fa2-ba3b-7ef59429df8a with scrape type 2
2026-03-28 05:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 538f7d47-b299-5fa2-ba3b-7ef59429df8a with scrape type 2
2026-03-28 05:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 538f7d47-b299-5fa2-ba3b-7ef59429df8a, identifier: WR55651
2026-03-28 05:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-28 05:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-28 05:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651 to the API
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:36:51Z',
 'fuel_type': 'diesel',
 'id': '538f7d47-b299-5fa2-ba3b-7ef59429df8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR55651',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 98280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six',
 'transmission': 'automatic',
 'trim': 'Generation Six',
 'year': 2019}
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-28 05:38:31 [auto1.de] INFO: Saving data for WR55651: {'auction_closing_time': 1774715811.0, 'created_time': 1774553242.649856, 'last_price_update_time': 1774676311.809316}
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR55651') HTTP/1.1" 204 0
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-28 05:38:31 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-28 05:38:31 [auto1.de] INFO: Scrape type for HU93536: 2
2026-03-28 05:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-28 05:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d454de6-0994-5e6a-888d-5748d3ad96ad with scrape type 2
2026-03-28 05:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d454de6-0994-5e6a-888d-5748d3ad96ad with scrape type 2
2026-03-28 05:38:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d454de6-0994-5e6a-888d-5748d3ad96ad, identifier: HU93536
2026-03-28 05:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-28 05:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-28 05:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536 to the API
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-28T16:30:15Z',
 'fuel_type': 'petrol',
 'id': '9d454de6-0994-5e6a-888d-5748d3ad96ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU93536',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 20869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-06',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Prime',
 'transmission': 'manual',
 'trim': 'Prime',
 'year': 2024}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Saving data for HU93536: {'auction_closing_time': 1774715415.0, 'created_time': 1774552969.211319, 'last_price_update_time': 1774676312.30785}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU93536') HTTP/1.1" 204 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Scrape type for EZ47162: 2
2026-03-28 05:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-28 05:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c87df5-f480-5907-b5ce-b7bfead12d6c with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6c87df5-f480-5907-b5ce-b7bfead12d6c with scrape type 2
2026-03-28 05:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6c87df5-f480-5907-b5ce-b7bfead12d6c, identifier: EZ47162
2026-03-28 05:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-28 05:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-28 05:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162 to the API
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:27:39Z',
 'fuel_type': 'diesel',
 'id': 'b6c87df5-f480-5907-b5ce-b7bfead12d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ47162',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 261000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-28 05:38:32 [auto1.de] INFO: Saving data for EZ47162: {'auction_closing_time': 1774715259.0, 'created_time': 1773344351.126572, 'last_price_update_time': 1774676312.861574}
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ47162') HTTP/1.1" 204 0
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-28 05:38:32 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-28 05:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:33 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20772%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for BB20772: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27147%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for XS27147: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC94378%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for EC94378: 0
2026-03-28 05:38:33 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-28 05:38:33 [auto1.de] INFO: Scrape type for YZ02891: 2
2026-03-28 05:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-28 05:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with scrape type 2
2026-03-28 05:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with scrape type 2
2026-03-28 05:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd, identifier: YZ02891
2026-03-28 05:38:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-28 05:38:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-28 05:38:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891 to the API
2026-03-28 05:38:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:01:58Z',
 'fuel_type': 'petrol',
 'id': '770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ02891',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 235118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-28',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Saving data for YZ02891: {'auction_closing_time': 1774713718.0, 'created_time': 1774553148.407623, 'last_price_update_time': 1774676314.146139}
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ02891') HTTP/1.1" 204 0
2026-03-28 05:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH17587%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for XH17587: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13893%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for LV13893: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for ZE28536: 2
2026-03-28 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-28 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e743ccce-91d0-5b52-843a-b9f15e136d17 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e743ccce-91d0-5b52-843a-b9f15e136d17 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e743ccce-91d0-5b52-843a-b9f15e136d17, identifier: ZE28536
2026-03-28 05:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-28 05:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-28 05:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536 to the API
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:16Z',
 'fuel_type': 'diesel',
 'id': 'e743ccce-91d0-5b52-843a-b9f15e136d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE28536',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Saving data for ZE28536: {'auction_closing_time': 1774716316.0, 'created_time': 1774552680.501876, 'last_price_update_time': 1774676314.749749}
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE28536') HTTP/1.1" 204 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW48266%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for TW48266: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD19209%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for VD19209: 0
2026-03-28 05:38:34 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB34489%27 HTTP/1.1" 200 None
2026-03-28 05:38:34 [auto1.de] INFO: Scrape type for LB34489: 2
2026-03-28 05:38:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e446a7-4f38-590c-8f3c-2517a74abbf9 with identifier: LB34489
2026-03-28 05:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e446a7-4f38-590c-8f3c-2517a74abbf9 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e446a7-4f38-590c-8f3c-2517a74abbf9 with scrape type 2
2026-03-28 05:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e446a7-4f38-590c-8f3c-2517a74abbf9, identifier: LB34489
2026-03-28 05:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e446a7-4f38-590c-8f3c-2517a74abbf9 with identifier: LB34489
2026-03-28 05:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e446a7-4f38-590c-8f3c-2517a74abbf9 with identifier: LB34489
2026-03-28 05:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e446a7-4f38-590c-8f3c-2517a74abbf9 with identifier: LB34489 to the API
2026-03-28 05:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:02:23Z',
 'fuel_type': 'diesel',
 'id': '93e446a7-4f38-590c-8f3c-2517a74abbf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB34489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 224590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB34489%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Saving data for LB34489: {'auction_closing_time': 1774713743.0, 'created_time': 1774464014.561103, 'last_price_update_time': 1774676315.254021}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB34489') HTTP/1.1" 204 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for FZ98450: 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22858%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for VG22858: 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: ZK19786
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM85963%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for JM85963: 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW45766%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for EW45766: 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Scrape type for MG33600: 2
2026-03-28 05:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-28 05:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62230ea2-c954-5105-a9e3-583c1ec14637 with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62230ea2-c954-5105-a9e3-583c1ec14637 with scrape type 2
2026-03-28 05:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62230ea2-c954-5105-a9e3-583c1ec14637, identifier: MG33600
2026-03-28 05:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-28 05:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-28 05:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600 to the API
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:22:20Z',
 'fuel_type': 'petrol',
 'id': '62230ea2-c954-5105-a9e3-583c1ec14637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG33600',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-28',
 'seller_name': None,
 'title': 'Audi A6 2.4 V6 quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 1999}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-28 05:38:35 [auto1.de] INFO: Saving data for MG33600: {'auction_closing_time': 1774714940.0, 'created_time': 1774552582.872309, 'last_price_update_time': 1774676315.864521}
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG33600') HTTP/1.1" 204 0
2026-03-28 05:38:35 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-28 05:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS78763%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for LS78763: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for MU83359: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for JD54519: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR17356%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for AR17356: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS95449%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for NS95449: 2
2026-03-28 05:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6287be-a371-5f39-908a-6334e451646d with identifier: NS95449
2026-03-28 05:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6287be-a371-5f39-908a-6334e451646d with scrape type 2
2026-03-28 05:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6287be-a371-5f39-908a-6334e451646d with scrape type 2
2026-03-28 05:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d6287be-a371-5f39-908a-6334e451646d, identifier: NS95449
2026-03-28 05:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d6287be-a371-5f39-908a-6334e451646d with identifier: NS95449
2026-03-28 05:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d6287be-a371-5f39-908a-6334e451646d with identifier: NS95449
2026-03-28 05:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d6287be-a371-5f39-908a-6334e451646d with identifier: NS95449 to the API
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:22:40Z',
 'fuel_type': 'petrol',
 'id': '0d6287be-a371-5f39-908a-6334e451646d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS95449',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 77632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-10',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS95449%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Saving data for NS95449: {'auction_closing_time': 1774714960.0, 'created_time': 1774466600.337746, 'last_price_update_time': 1774676316.501607}
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS95449') HTTP/1.1" 204 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79690%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for SP79690: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP42070%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for JP42070: 0
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 05:38:36 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-28 05:38:36 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-28 05:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:37 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for ET23804: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB09111%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for JB09111: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG10773%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for PG10773: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH76939%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for UH76939: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for VS98384: 2
2026-03-28 05:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-28 05:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145f8591-d586-5d42-8b9f-4082b34ae055 with scrape type 2
2026-03-28 05:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145f8591-d586-5d42-8b9f-4082b34ae055 with scrape type 2
2026-03-28 05:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 145f8591-d586-5d42-8b9f-4082b34ae055, identifier: VS98384
2026-03-28 05:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-28 05:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-28 05:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384 to the API
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-28T16:36:38Z',
 'fuel_type': 'petrol',
 'id': '145f8591-d586-5d42-8b9f-4082b34ae055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS98384',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 162361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-02-29',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Liftback Terra',
 'transmission': 'manual',
 'trim': 'Liftback Terra',
 'year': 2000}
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Saving data for VS98384: {'auction_closing_time': 1774715798.0, 'created_time': 1774550639.451163, 'last_price_update_time': 1774676317.797307}
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS98384') HTTP/1.1" 204 0
2026-03-28 05:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB55378%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for TB55378: 0
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 05:38:37 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01052%27 HTTP/1.1" 200 None
2026-03-28 05:38:37 [auto1.de] INFO: Scrape type for AP01052: 2
2026-03-28 05:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55405457-3d57-5a05-8fd9-ffc087ef82d2 with identifier: AP01052
2026-03-28 05:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55405457-3d57-5a05-8fd9-ffc087ef82d2 with scrape type 2
2026-03-28 05:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55405457-3d57-5a05-8fd9-ffc087ef82d2 with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55405457-3d57-5a05-8fd9-ffc087ef82d2, identifier: AP01052
2026-03-28 05:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55405457-3d57-5a05-8fd9-ffc087ef82d2 with identifier: AP01052
2026-03-28 05:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55405457-3d57-5a05-8fd9-ffc087ef82d2 with identifier: AP01052
2026-03-28 05:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55405457-3d57-5a05-8fd9-ffc087ef82d2 with identifier: AP01052 to the API
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'hybrid',
 'id': '55405457-3d57-5a05-8fd9-ffc087ef82d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP01052',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 60154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-29',
 'seller_name': None,
 'title': 'Audi A3 Sportback 40 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01052%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Saving data for AP01052: {'auction_closing_time': 1774714147.0, 'created_time': 1774550583.66886, 'last_price_update_time': 1774676318.363069}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP01052') HTTP/1.1" 204 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for XR03491: 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: UE89498
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for JP65265: 2
2026-03-28 05:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-28 05:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49610941-d8d7-56ab-8f56-afccadb68576 with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49610941-d8d7-56ab-8f56-afccadb68576 with scrape type 2
2026-03-28 05:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49610941-d8d7-56ab-8f56-afccadb68576, identifier: JP65265
2026-03-28 05:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-28 05:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265
2026-03-28 05:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49610941-d8d7-56ab-8f56-afccadb68576 with identifier: JP65265 to the API
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:49:15Z',
 'fuel_type': 'hybrid',
 'id': '49610941-d8d7-56ab-8f56-afccadb68576',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP65265',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 34832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-09',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Saving data for JP65265: {'auction_closing_time': 1774716555.0, 'created_time': 1774463915.549183, 'last_price_update_time': 1774676318.827418}
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP65265') HTTP/1.1" 204 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET53588%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for ET53588: 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP60172%27 HTTP/1.1" 200 None
2026-03-28 05:38:38 [auto1.de] INFO: Scrape type for NP60172: 0
2026-03-28 05:38:38 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 05:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT75700%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for TT75700: 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for EH96711: 2
2026-03-28 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-28 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82, identifier: EH96711
2026-03-28 05:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-28 05:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-28 05:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711 to the API
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:45:36Z',
 'fuel_type': 'diesel',
 'id': 'c6e6930a-f47a-5c27-a0ac-e8a3602a3f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH96711',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 281510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-20',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Saving data for EH96711: {'auction_closing_time': 1774716336.0, 'created_time': 1773946608.675762, 'last_price_update_time': 1774676319.443946}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH96711') HTTP/1.1" 204 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for HA98993: 2
2026-03-28 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-28 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9907a0-5637-56b4-8919-da25d17c3dc2 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f9907a0-5637-56b4-8919-da25d17c3dc2 with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f9907a0-5637-56b4-8919-da25d17c3dc2, identifier: HA98993
2026-03-28 05:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-28 05:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-28 05:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993 to the API
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:22Z',
 'fuel_type': 'petrol',
 'id': '4f9907a0-5637-56b4-8919-da25d17c3dc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98993',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 155342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-16',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition "111 Jahre"',
 'transmission': 'automatic',
 'trim': 'Edition "111 Jahre"',
 'year': 2012}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Saving data for HA98993: {'auction_closing_time': 1774717042.0, 'created_time': 1774552381.338861, 'last_price_update_time': 1774676319.881187}
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA98993') HTTP/1.1" 204 0
2026-03-28 05:38:39 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-28 05:38:39 [auto1.de] INFO: Scrape type for WN68055: 2
2026-03-28 05:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-28 05:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c01bc8-b3ce-532b-9a84-5613b144511f with scrape type 2
2026-03-28 05:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13c01bc8-b3ce-532b-9a84-5613b144511f with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13c01bc8-b3ce-532b-9a84-5613b144511f, identifier: WN68055
2026-03-28 05:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-28 05:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-28 05:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055 to the API
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:11:23Z',
 'fuel_type': 'petrol',
 'id': '13c01bc8-b3ce-532b-9a84-5613b144511f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN68055',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 73352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-22',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Cup up!',
 'transmission': 'automatic',
 'trim': 'Cup',
 'year': 2014}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Saving data for WN68055: {'auction_closing_time': 1774714283.0, 'created_time': 1774550721.99181, 'last_price_update_time': 1774676320.318705}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN68055') HTTP/1.1" 204 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for UA56207: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for DA12198: 2
2026-03-28 05:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-28 05:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8799a3c5-4391-589b-b503-89aad1d4f97b with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8799a3c5-4391-589b-b503-89aad1d4f97b with scrape type 2
2026-03-28 05:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8799a3c5-4391-589b-b503-89aad1d4f97b, identifier: DA12198
2026-03-28 05:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-28 05:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-28 05:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198 to the API
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:31:30Z',
 'fuel_type': 'petrol',
 'id': '8799a3c5-4391-589b-b503-89aad1d4f97b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA12198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 99351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSI quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2021}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Saving data for DA12198: {'auction_closing_time': 1774715490.0, 'created_time': 1774550511.078449, 'last_price_update_time': 1774676320.78089}
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA12198') HTTP/1.1" 204 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for MM33078: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for GT81151: 0
2026-03-28 05:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:40 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-28 05:38:40 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-28 05:38:40 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31164%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for EY31164: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27402%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for DM27402: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for BU80975: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF16593%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for EF16593: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86384%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for DC86384: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL03429%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for XL03429: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME80175%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for ME80175: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for MM33465: 2
2026-03-28 05:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-28 05:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with scrape type 2
2026-03-28 05:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with scrape type 2
2026-03-28 05:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82, identifier: MM33465
2026-03-28 05:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-28 05:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-28 05:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465 to the API
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'petrol',
 'id': '8efa675e-2ebc-5b98-b31f-ebc4fa515a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM33465',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '626',
 'odometer': 103265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1989-09-25',
 'seller_name': None,
 'title': 'Mazda 626 2.0 GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 1989}
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Saving data for MM33465: {'auction_closing_time': 1774713977.0, 'created_time': 1774552361.714931, 'last_price_update_time': 1774676321.584782}
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM33465') HTTP/1.1" 204 0
2026-03-28 05:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD09618%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for GD09618: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73763%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for DG73763: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM75800%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for DM75800: 0
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 05:38:41 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-28 05:38:41 [auto1.de] INFO: Scrape type for WY50003: 2
2026-03-28 05:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-28 05:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with scrape type 2
2026-03-28 05:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with scrape type 2
2026-03-28 05:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59, identifier: WY50003
2026-03-28 05:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-28 05:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-28 05:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003 to the API
2026-03-28 05:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'diesel',
 'id': 'c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY50003',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 99922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-28 05:38:42 [auto1.de] INFO: Saving data for WY50003: {'auction_closing_time': 1774713977.0, 'created_time': 1774552814.889691, 'last_price_update_time': 1774676322.183203}
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY50003') HTTP/1.1" 204 0
2026-03-28 05:38:42 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-28 05:38:42 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-28 05:38:42 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-28 05:38:42 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-28 05:38:42 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ03116%27 HTTP/1.1" 200 None
2026-03-28 05:38:42 [auto1.de] INFO: Scrape type for XJ03116: 2
2026-03-28 05:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89416189-4878-57fd-a097-71f83877af42 with identifier: XJ03116
2026-03-28 05:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89416189-4878-57fd-a097-71f83877af42 with scrape type 2
2026-03-28 05:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89416189-4878-57fd-a097-71f83877af42 with scrape type 2
2026-03-28 05:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89416189-4878-57fd-a097-71f83877af42, identifier: XJ03116
2026-03-28 05:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89416189-4878-57fd-a097-71f83877af42 with identifier: XJ03116
2026-03-28 05:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89416189-4878-57fd-a097-71f83877af42 with identifier: XJ03116
2026-03-28 05:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89416189-4878-57fd-a097-71f83877af42 with identifier: XJ03116 to the API
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:40:17Z',
 'fuel_type': 'petrol',
 'id': '89416189-4878-57fd-a097-71f83877af42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ03116',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 60447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ03116%27 HTTP/1.1" 200 None
2026-03-28 05:38:42 [auto1.de] INFO: Saving data for XJ03116: {'auction_closing_time': 1774716017.0, 'created_time': 1774553046.230781, 'last_price_update_time': 1774676322.778833}
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ03116') HTTP/1.1" 204 0
2026-03-28 05:38:42 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ22872%27 HTTP/1.1" 200 None
2026-03-28 05:38:42 [auto1.de] INFO: Scrape type for GJ22872: 2
2026-03-28 05:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4f7e623-7842-5d3b-b09c-ca9a40983b47 with identifier: GJ22872
2026-03-28 05:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4f7e623-7842-5d3b-b09c-ca9a40983b47 with scrape type 2
2026-03-28 05:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4f7e623-7842-5d3b-b09c-ca9a40983b47 with scrape type 2
2026-03-28 05:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4f7e623-7842-5d3b-b09c-ca9a40983b47, identifier: GJ22872
2026-03-28 05:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4f7e623-7842-5d3b-b09c-ca9a40983b47 with identifier: GJ22872
2026-03-28 05:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4f7e623-7842-5d3b-b09c-ca9a40983b47 with identifier: GJ22872
2026-03-28 05:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4f7e623-7842-5d3b-b09c-ca9a40983b47 with identifier: GJ22872 to the API
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:03:05Z',
 'fuel_type': 'petrol',
 'id': 'c4f7e623-7842-5d3b-b09c-ca9a40983b47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ22872',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 184353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-01',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ22872%27 HTTP/1.1" 200 None
2026-03-28 05:38:43 [auto1.de] INFO: Saving data for GJ22872: {'auction_closing_time': 1774713785.0, 'created_time': 1774552587.296584, 'last_price_update_time': 1774676323.205368}
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ22872') HTTP/1.1" 204 0
2026-03-28 05:38:43 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY83688%27 HTTP/1.1" 200 None
2026-03-28 05:38:43 [auto1.de] INFO: Scrape type for LY83688: 0
2026-03-28 05:38:43 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 05:38:43 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-28 05:38:43 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-28 05:38:43 [auto1.de] INFO: Scrape type for WK97473: 2
2026-03-28 05:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-28 05:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with scrape type 2
2026-03-28 05:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with scrape type 2
2026-03-28 05:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fe2c93e-939e-5999-8a8d-39c04e73ca01, identifier: WK97473
2026-03-28 05:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-28 05:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-28 05:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473 to the API
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:10Z',
 'fuel_type': 'diesel',
 'id': '7fe2c93e-939e-5999-8a8d-39c04e73ca01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK97473',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 96358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Beach BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Beach BlueMotion',
 'year': 2017}
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-28 05:38:43 [auto1.de] INFO: Saving data for WK97473: {'auction_closing_time': 1774716550.0, 'created_time': 1774552637.633485, 'last_price_update_time': 1774676323.726281}
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK97473') HTTP/1.1" 204 0
2026-03-28 05:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:44 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:44 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-28 05:38:44 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-28 05:38:44 [auto1.de] INFO: Scrape type for XD31530: 2
2026-03-28 05:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-28 05:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93d641a-54ad-5557-a932-20caed0d3de3 with scrape type 2
2026-03-28 05:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f93d641a-54ad-5557-a932-20caed0d3de3 with scrape type 2
2026-03-28 05:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f93d641a-54ad-5557-a932-20caed0d3de3, identifier: XD31530
2026-03-28 05:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-28 05:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-28 05:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530 to the API
2026-03-28 05:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:05:15Z',
 'fuel_type': 'petrol',
 'id': 'f93d641a-54ad-5557-a932-20caed0d3de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD31530',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 133189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-28 05:38:45 [auto1.de] INFO: Saving data for XD31530: {'auction_closing_time': 1774713915.0, 'created_time': 1774589753.790147, 'last_price_update_time': 1774676325.105886}
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD31530') HTTP/1.1" 204 0
2026-03-28 05:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:45 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU08337%27 HTTP/1.1" 200 None
2026-03-28 05:38:45 [auto1.de] INFO: Scrape type for UU08337: 2
2026-03-28 05:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08e29eb-10af-5924-be69-1ff1e72f0117 with identifier: UU08337
2026-03-28 05:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08e29eb-10af-5924-be69-1ff1e72f0117 with scrape type 2
2026-03-28 05:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a08e29eb-10af-5924-be69-1ff1e72f0117 with scrape type 2
2026-03-28 05:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a08e29eb-10af-5924-be69-1ff1e72f0117, identifier: UU08337
2026-03-28 05:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a08e29eb-10af-5924-be69-1ff1e72f0117 with identifier: UU08337
2026-03-28 05:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a08e29eb-10af-5924-be69-1ff1e72f0117 with identifier: UU08337
2026-03-28 05:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a08e29eb-10af-5924-be69-1ff1e72f0117 with identifier: UU08337 to the API
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:56:16Z',
 'fuel_type': 'petrol',
 'id': 'a08e29eb-10af-5924-be69-1ff1e72f0117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU08337',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 111953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU08337%27 HTTP/1.1" 200 None
2026-03-28 05:38:45 [auto1.de] INFO: Saving data for UU08337: {'auction_closing_time': 1774716976.0, 'created_time': 1774466615.83073, 'last_price_update_time': 1774676325.613146}
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU08337') HTTP/1.1" 204 0
2026-03-28 05:38:45 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-28 05:38:45 [auto1.de] INFO: Scrape type for ZK10618: 2
2026-03-28 05:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-28 05:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefb1c9b-020c-55b0-a841-7edda4e84408 with scrape type 2
2026-03-28 05:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fefb1c9b-020c-55b0-a841-7edda4e84408 with scrape type 2
2026-03-28 05:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fefb1c9b-020c-55b0-a841-7edda4e84408, identifier: ZK10618
2026-03-28 05:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-28 05:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-28 05:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618 to the API
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:35:16Z',
 'fuel_type': 'diesel',
 'id': 'fefb1c9b-020c-55b0-a841-7edda4e84408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK10618',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 180622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Ambition-A 4x4',
 'transmission': 'manual',
 'trim': 'Ambition-A 4x4',
 'year': 2011}
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Saving data for ZK10618: {'auction_closing_time': 1774715716.0, 'created_time': 1774552829.168627, 'last_price_update_time': 1774676326.056646}
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK10618') HTTP/1.1" 204 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU22697%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for BU22697: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX87155%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for KX87155: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57844%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for BC57844: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for VF37611: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62628%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for MN62628: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for ZU15284: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH11790%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for ZH11790: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE56865%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for XE56865: 2
2026-03-28 05:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80233bc7-33e1-5293-b711-9d0ec7d576b8 with identifier: XE56865
2026-03-28 05:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80233bc7-33e1-5293-b711-9d0ec7d576b8 with scrape type 2
2026-03-28 05:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80233bc7-33e1-5293-b711-9d0ec7d576b8 with scrape type 2
2026-03-28 05:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80233bc7-33e1-5293-b711-9d0ec7d576b8, identifier: XE56865
2026-03-28 05:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80233bc7-33e1-5293-b711-9d0ec7d576b8 with identifier: XE56865
2026-03-28 05:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80233bc7-33e1-5293-b711-9d0ec7d576b8 with identifier: XE56865
2026-03-28 05:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80233bc7-33e1-5293-b711-9d0ec7d576b8 with identifier: XE56865 to the API
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:02:22Z',
 'fuel_type': 'petrol',
 'id': '80233bc7-33e1-5293-b711-9d0ec7d576b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE56865',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 170988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-21',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2005}
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE56865%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Saving data for XE56865: {'auction_closing_time': 1774713742.0, 'created_time': 1773226828.158533, 'last_price_update_time': 1774676326.632556}
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE56865') HTTP/1.1" 204 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for AG24612: 0
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 05:38:46 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ81394%27 HTTP/1.1" 200 None
2026-03-28 05:38:46 [auto1.de] INFO: Scrape type for JZ81394: 2
2026-03-28 05:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a341f0-2d06-5008-9237-31d2c6971024 with identifier: JZ81394
2026-03-28 05:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a341f0-2d06-5008-9237-31d2c6971024 with scrape type 2
2026-03-28 05:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a341f0-2d06-5008-9237-31d2c6971024 with scrape type 2
2026-03-28 05:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15a341f0-2d06-5008-9237-31d2c6971024, identifier: JZ81394
2026-03-28 05:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15a341f0-2d06-5008-9237-31d2c6971024 with identifier: JZ81394
2026-03-28 05:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15a341f0-2d06-5008-9237-31d2c6971024 with identifier: JZ81394
2026-03-28 05:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15a341f0-2d06-5008-9237-31d2c6971024 with identifier: JZ81394 to the API
2026-03-28 05:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:05:10Z',
 'fuel_type': 'petrol',
 'id': '15a341f0-2d06-5008-9237-31d2c6971024',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ81394',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 196180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI CGI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'CGI BlueEfficiency Elegance',
 'year': 2010}
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ81394%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Saving data for JZ81394: {'auction_closing_time': 1774713910.0, 'created_time': 1774468221.236557, 'last_price_update_time': 1774676327.179187}
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ81394') HTTP/1.1" 204 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for XL13857: 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for HP37567: 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN46054%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for YN46054: 2
2026-03-28 05:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b8f33b-a476-511f-aa0b-64e26b60a878 with identifier: YN46054
2026-03-28 05:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b8f33b-a476-511f-aa0b-64e26b60a878 with scrape type 2
2026-03-28 05:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17b8f33b-a476-511f-aa0b-64e26b60a878 with scrape type 2
2026-03-28 05:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b8f33b-a476-511f-aa0b-64e26b60a878, identifier: YN46054
2026-03-28 05:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b8f33b-a476-511f-aa0b-64e26b60a878 with identifier: YN46054
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 05:38:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b8f33b-a476-511f-aa0b-64e26b60a878 with identifier: YN46054
2026-03-28 05:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b8f33b-a476-511f-aa0b-64e26b60a878 with identifier: YN46054 to the API
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:36:49Z',
 'fuel_type': 'gas',
 'id': '17b8f33b-a476-511f-aa0b-64e26b60a878',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN46054',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 98209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-02',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2022}
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN46054%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Saving data for YN46054: {'auction_closing_time': 1774715809.0, 'created_time': 1774463879.393178, 'last_price_update_time': 1774676327.797465}
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN46054') HTTP/1.1" 204 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA81194%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for ZA81194: 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL31001%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for PL31001: 0
2026-03-28 05:38:47 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-28 05:38:47 [auto1.de] INFO: Scrape type for RU30790: 2
2026-03-28 05:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-28 05:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caed2394-e8e5-56e6-b980-50de70539c18 with scrape type 2
2026-03-28 05:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caed2394-e8e5-56e6-b980-50de70539c18 with scrape type 2
2026-03-28 05:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caed2394-e8e5-56e6-b980-50de70539c18, identifier: RU30790
2026-03-28 05:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-28 05:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790
2026-03-28 05:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caed2394-e8e5-56e6-b980-50de70539c18 with identifier: RU30790 to the API
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:28Z',
 'fuel_type': 'petrol',
 'id': 'caed2394-e8e5-56e6-b980-50de70539c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU30790',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Starlet',
 'odometer': 87497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-05-18',
 'seller_name': None,
 'title': 'Toyota Starlet 1.3 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 1995}
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Saving data for RU30790: {'auction_closing_time': 1774716748.0, 'created_time': 1774466640.22752, 'last_price_update_time': 1774676328.373316}
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU30790') HTTP/1.1" 204 0
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Scrape type for XF49404: 0
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-28 05:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:48 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92040%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Scrape type for PB92040: 0
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Scrape type for LP86406: 2
2026-03-28 05:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-28 05:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with scrape type 2
2026-03-28 05:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with scrape type 2
2026-03-28 05:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5, identifier: LP86406
2026-03-28 05:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-28 05:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-28 05:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406 to the API
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:28:19Z',
 'fuel_type': 'petrol',
 'id': '7d1899c9-a698-5122-b796-a8b6dd2ec5a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP86406',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 65103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-28 05:38:48 [auto1.de] INFO: Saving data for LP86406: {'auction_closing_time': 1774715299.0, 'created_time': 1774553042.33066, 'last_price_update_time': 1774676328.96027}
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP86406') HTTP/1.1" 204 0
2026-03-28 05:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:48 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 05:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for FN16508: 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for AS18464: 2
2026-03-28 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-28 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edabeeff-f959-564e-99c2-a382ccaeaa28 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edabeeff-f959-564e-99c2-a382ccaeaa28 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edabeeff-f959-564e-99c2-a382ccaeaa28, identifier: AS18464
2026-03-28 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-28 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-28 05:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464 to the API
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:33Z',
 'fuel_type': 'petrol',
 'id': 'edabeeff-f959-564e-99c2-a382ccaeaa28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS18464',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 130193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-23',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC Filou',
 'transmission': 'manual',
 'trim': 'CC Filou',
 'year': 2005}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Saving data for AS18464: {'auction_closing_time': 1774715013.0, 'created_time': 1774552905.342277, 'last_price_update_time': 1774676329.45333}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS18464') HTTP/1.1" 204 0
2026-03-28 05:38:49 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Scrape type for HY48346: 2
2026-03-28 05:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-28 05:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with scrape type 2
2026-03-28 05:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a11bc48-fb8a-5d65-996f-d1fe079ce862, identifier: HY48346
2026-03-28 05:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-28 05:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-28 05:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346 to the API
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:28Z',
 'fuel_type': 'diesel',
 'id': '1a11bc48-fb8a-5d65-996f-d1fe079ce862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY48346',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 271158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-28 05:38:49 [auto1.de] INFO: Saving data for HY48346: {'auction_closing_time': 1774715488.0, 'created_time': 1774552962.888026, 'last_price_update_time': 1774676329.980144}
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY48346') HTTP/1.1" 204 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for JZ38471: 2
2026-03-28 05:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-28 05:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a178fc35-249d-564c-98ea-4bb8a5056182 with scrape type 2
2026-03-28 05:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a178fc35-249d-564c-98ea-4bb8a5056182 with scrape type 2
2026-03-28 05:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a178fc35-249d-564c-98ea-4bb8a5056182, identifier: JZ38471
2026-03-28 05:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-28 05:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-28 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471 to the API
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-28T16:05:44Z',
 'fuel_type': 'petrol',
 'id': 'a178fc35-249d-564c-98ea-4bb8a5056182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ38471',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 167600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Lancia Voyager 3.6 V6 Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2017}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Saving data for JZ38471: {'auction_closing_time': 1774713944.0, 'created_time': 1774550870.208829, 'last_price_update_time': 1774676330.435147}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ38471') HTTP/1.1" 204 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92470%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for MV92470: 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW23219%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for VW23219: 2
2026-03-28 05:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55696b0-a52d-5899-aed6-32c43912a3df with identifier: VW23219
2026-03-28 05:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55696b0-a52d-5899-aed6-32c43912a3df with scrape type 2
2026-03-28 05:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55696b0-a52d-5899-aed6-32c43912a3df with scrape type 2
2026-03-28 05:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e55696b0-a52d-5899-aed6-32c43912a3df, identifier: VW23219
2026-03-28 05:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e55696b0-a52d-5899-aed6-32c43912a3df with identifier: VW23219
2026-03-28 05:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e55696b0-a52d-5899-aed6-32c43912a3df with identifier: VW23219
2026-03-28 05:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e55696b0-a52d-5899-aed6-32c43912a3df with identifier: VW23219 to the API
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:42Z',
 'fuel_type': 'diesel',
 'id': 'e55696b0-a52d-5899-aed6-32c43912a3df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW23219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 207556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW23219%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Saving data for VW23219: {'auction_closing_time': 1774716762.0, 'created_time': 1774466549.631614, 'last_price_update_time': 1774676330.879809}
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW23219') HTTP/1.1" 204 0
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: YZ46630
2026-03-28 05:38:50 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43867%27 HTTP/1.1" 200 None
2026-03-28 05:38:50 [auto1.de] INFO: Scrape type for ZU43867: 2
2026-03-28 05:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with identifier: ZU43867
2026-03-28 05:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with scrape type 2
2026-03-28 05:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with scrape type 2
2026-03-28 05:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8789b2c0-3cae-5798-a9cc-f8927e29eb41, identifier: ZU43867
2026-03-28 05:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with identifier: ZU43867
2026-03-28 05:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with identifier: ZU43867
2026-03-28 05:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8789b2c0-3cae-5798-a9cc-f8927e29eb41 with identifier: ZU43867 to the API
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-28T16:03:18Z',
 'fuel_type': 'petrol',
 'id': '8789b2c0-3cae-5798-a9cc-f8927e29eb41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU43867',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 87967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Cross',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2019}
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43867%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Saving data for ZU43867: {'auction_closing_time': 1774713798.0, 'created_time': 1774467845.531406, 'last_price_update_time': 1774676331.383133}
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU43867') HTTP/1.1" 204 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for SD35692: 2
2026-03-28 05:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-28 05:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92effc51-2cae-5f57-bc01-95a1522757dd with scrape type 2
2026-03-28 05:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92effc51-2cae-5f57-bc01-95a1522757dd with scrape type 2
2026-03-28 05:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92effc51-2cae-5f57-bc01-95a1522757dd, identifier: SD35692
2026-03-28 05:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-28 05:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-28 05:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692 to the API
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:22:51Z',
 'fuel_type': 'petrol',
 'id': '92effc51-2cae-5f57-bc01-95a1522757dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD35692',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 78233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Saving data for SD35692: {'auction_closing_time': 1774714971.0, 'created_time': 1774550687.251769, 'last_price_update_time': 1774676331.817658}
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD35692') HTTP/1.1" 204 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE96769%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for KE96769: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH65606%27 HTTP/1.1" 200 None
2026-03-28 05:38:51 [auto1.de] INFO: Scrape type for YH65606: 0
2026-03-28 05:38:51 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL74101%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for KL74101: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ80177%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for TJ80177: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45224%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for SL45224: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-28 05:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:52 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for KH18492: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF45527%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for BF45527: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA82513%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for CA82513: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY13097%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for RY13097: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for FH05972: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for NV31897: 2
2026-03-28 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-28 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf75116-e709-5a20-a5de-ce0429eb7835 with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf75116-e709-5a20-a5de-ce0429eb7835 with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf75116-e709-5a20-a5de-ce0429eb7835, identifier: NV31897
2026-03-28 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-28 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-28 05:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897 to the API
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:17Z',
 'fuel_type': 'petrol',
 'id': 'cbf75116-e709-5a20-a5de-ce0429eb7835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV31897',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 207287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Saving data for NV31897: {'auction_closing_time': 1774716977.0, 'created_time': 1774553114.885353, 'last_price_update_time': 1774676332.730048}
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV31897') HTTP/1.1" 204 0
2026-03-28 05:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN09397%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for NN09397: 0
2026-03-28 05:38:52 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-28 05:38:52 [auto1.de] INFO: Scrape type for ME32399: 2
2026-03-28 05:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-28 05:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f28acc88-0151-5622-9dad-be79e1554dda with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f28acc88-0151-5622-9dad-be79e1554dda with scrape type 2
2026-03-28 05:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f28acc88-0151-5622-9dad-be79e1554dda, identifier: ME32399
2026-03-28 05:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-28 05:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399
2026-03-28 05:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f28acc88-0151-5622-9dad-be79e1554dda with identifier: ME32399 to the API
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'petrol',
 'id': 'f28acc88-0151-5622-9dad-be79e1554dda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME32399',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 158155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Saving data for ME32399: {'auction_closing_time': 1774715706.0, 'created_time': 1773226160.523584, 'last_price_update_time': 1774676333.304066}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME32399') HTTP/1.1" 204 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for ZT22955: 2
2026-03-28 05:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1115f89-0386-529e-a19c-30e1a62c23cc with identifier: ZT22955
2026-03-28 05:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1115f89-0386-529e-a19c-30e1a62c23cc with scrape type 2
2026-03-28 05:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1115f89-0386-529e-a19c-30e1a62c23cc with scrape type 2
2026-03-28 05:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1115f89-0386-529e-a19c-30e1a62c23cc, identifier: ZT22955
2026-03-28 05:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1115f89-0386-529e-a19c-30e1a62c23cc with identifier: ZT22955
2026-03-28 05:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1115f89-0386-529e-a19c-30e1a62c23cc with identifier: ZT22955
2026-03-28 05:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1115f89-0386-529e-a19c-30e1a62c23cc with identifier: ZT22955 to the API
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:37Z',
 'fuel_type': 'diesel',
 'id': 'd1115f89-0386-529e-a19c-30e1a62c23cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT22955',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 149143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'BMW 5er 520d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Saving data for ZT22955: {'auction_closing_time': 1774715917.0, 'created_time': 1774552847.051643, 'last_price_update_time': 1774676333.756594}
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT22955') HTTP/1.1" 204 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for DZ38540: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM81264%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for WM81264: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-28 05:38:53 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-28 05:38:53 [auto1.de] INFO: Scrape type for CF43434: 2
2026-03-28 05:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-28 05:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3224462b-f399-577e-a3ce-1665bd337466 with scrape type 2
2026-03-28 05:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3224462b-f399-577e-a3ce-1665bd337466 with scrape type 2
2026-03-28 05:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3224462b-f399-577e-a3ce-1665bd337466, identifier: CF43434
2026-03-28 05:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-28 05:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-28 05:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434 to the API
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:40Z',
 'fuel_type': 'diesel',
 'id': '3224462b-f399-577e-a3ce-1665bd337466',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF43434',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 173320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Saving data for CF43434: {'auction_closing_time': 1774716760.0, 'created_time': 1774553228.83908, 'last_price_update_time': 1774676334.286155}
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF43434') HTTP/1.1" 204 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT79731%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for FT79731: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for LW30512: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC02400%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for LC02400: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for YJ00075: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-28 05:38:54 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 05:38:54 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-28 05:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:55 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU62760%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for WU62760: 0
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE12513%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for TE12513: 2
2026-03-28 05:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedcf0bb-d226-5b4d-b273-4eb4ad456baa with identifier: TE12513
2026-03-28 05:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedcf0bb-d226-5b4d-b273-4eb4ad456baa with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dedcf0bb-d226-5b4d-b273-4eb4ad456baa with scrape type 2
2026-03-28 05:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dedcf0bb-d226-5b4d-b273-4eb4ad456baa, identifier: TE12513
2026-03-28 05:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dedcf0bb-d226-5b4d-b273-4eb4ad456baa with identifier: TE12513
2026-03-28 05:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dedcf0bb-d226-5b4d-b273-4eb4ad456baa with identifier: TE12513
2026-03-28 05:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dedcf0bb-d226-5b4d-b273-4eb4ad456baa with identifier: TE12513 to the API
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:06:18Z',
 'fuel_type': 'petrol',
 'id': 'dedcf0bb-d226-5b4d-b273-4eb4ad456baa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE12513',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 317986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-08',
 'seller_name': None,
 'title': 'Volvo V70 2.0 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2008}
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE12513%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Saving data for TE12513: {'auction_closing_time': 1774713978.0, 'created_time': 1774467994.871178, 'last_price_update_time': 1774676335.871729}
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE12513') HTTP/1.1" 204 0
2026-03-28 05:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM94647%27 HTTP/1.1" 200 None
2026-03-28 05:38:55 [auto1.de] INFO: Scrape type for GM94647: 0
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-28 05:38:55 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK30038%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for GK30038: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP84126%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for ZP84126: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ53691%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for MZ53691: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for JC14398: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11673%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for EJ11673: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP79065%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for GP79065: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV76032%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for WV76032: 2
2026-03-28 05:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-03-28 05:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb2f3adb-a805-5a69-92ea-05b46233db75 with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb2f3adb-a805-5a69-92ea-05b46233db75 with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb2f3adb-a805-5a69-92ea-05b46233db75, identifier: WV76032
2026-03-28 05:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-03-28 05:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032
2026-03-28 05:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb2f3adb-a805-5a69-92ea-05b46233db75 with identifier: WV76032 to the API
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:28Z',
 'fuel_type': 'diesel',
 'id': 'bb2f3adb-a805-5a69-92ea-05b46233db75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV76032',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 240001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2015}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV76032%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Saving data for WV76032: {'auction_closing_time': 1774715068.0, 'created_time': 1774467800.603321, 'last_price_update_time': 1774676336.556683}
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV76032') HTTP/1.1" 204 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG77617%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for KG77617: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU63901%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for ZU63901: 0
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-28 05:38:56 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-28 05:38:56 [auto1.de] INFO: Scrape type for HC04240: 2
2026-03-28 05:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-28 05:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f8b009-ae01-5381-8a08-fac082b47fa7 with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35f8b009-ae01-5381-8a08-fac082b47fa7 with scrape type 2
2026-03-28 05:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35f8b009-ae01-5381-8a08-fac082b47fa7, identifier: HC04240
2026-03-28 05:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-28 05:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-28 05:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240 to the API
2026-03-28 05:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:25:19Z',
 'fuel_type': 'petrol',
 'id': '35f8b009-ae01-5381-8a08-fac082b47fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC04240',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 125306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Saving data for HC04240: {'auction_closing_time': 1774715119.0, 'created_time': 1774552827.28951, 'last_price_update_time': 1774676337.124227}
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC04240') HTTP/1.1" 204 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV64998%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for MV64998: 2
2026-03-28 05:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c02380-52af-5dc8-8700-27fb7d91a989 with identifier: MV64998
2026-03-28 05:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c02380-52af-5dc8-8700-27fb7d91a989 with scrape type 2
2026-03-28 05:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70c02380-52af-5dc8-8700-27fb7d91a989 with scrape type 2
2026-03-28 05:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70c02380-52af-5dc8-8700-27fb7d91a989, identifier: MV64998
2026-03-28 05:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70c02380-52af-5dc8-8700-27fb7d91a989 with identifier: MV64998
2026-03-28 05:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70c02380-52af-5dc8-8700-27fb7d91a989 with identifier: MV64998
2026-03-28 05:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70c02380-52af-5dc8-8700-27fb7d91a989 with identifier: MV64998 to the API
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:56:06Z',
 'fuel_type': 'hybrid',
 'id': '70c02380-52af-5dc8-8700-27fb7d91a989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV64998',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 118538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Edition 2014',
 'transmission': 'automatic',
 'trim': 'Edition 2014',
 'year': 2014}
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV64998%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Saving data for MV64998: {'auction_closing_time': 1774716966.0, 'created_time': 1774550612.789082, 'last_price_update_time': 1774676337.545607}
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV64998') HTTP/1.1" 204 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA77948%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for FA77948: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-28 05:38:57 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-28 05:38:57 [auto1.de] INFO: Scrape type for WP14042: 2
2026-03-28 05:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-28 05:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with scrape type 2
2026-03-28 05:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with scrape type 2
2026-03-28 05:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170, identifier: WP14042
2026-03-28 05:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-28 05:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-28 05:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042 to the API
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:52:24Z',
 'fuel_type': 'petrol',
 'id': '9f383db9-fdf3-5e58-a5f2-c1e57deaa170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP14042',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 103171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-31',
 'seller_name': None,
 'title': 'Audi A3 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2004}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Saving data for WP14042: {'auction_closing_time': 1774716744.0, 'created_time': 1774553056.918231, 'last_price_update_time': 1774676338.068505}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP14042') HTTP/1.1" 204 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for GF22355: 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for XA54655: 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for YB86536: 2
2026-03-28 05:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-28 05:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebeb800-320a-5635-abf0-2a1af077d0e0 with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eebeb800-320a-5635-abf0-2a1af077d0e0 with scrape type 2
2026-03-28 05:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eebeb800-320a-5635-abf0-2a1af077d0e0, identifier: YB86536
2026-03-28 05:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-28 05:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-28 05:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536 to the API
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:32:47Z',
 'fuel_type': 'diesel',
 'id': 'eebeb800-320a-5635-abf0-2a1af077d0e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB86536',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 158768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Saving data for YB86536: {'auction_closing_time': 1774715567.0, 'created_time': 1774589756.569713, 'last_price_update_time': 1774676338.712831}
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB86536') HTTP/1.1" 204 0
2026-03-28 05:38:58 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC96921%27 HTTP/1.1" 200 None
2026-03-28 05:38:58 [auto1.de] INFO: Scrape type for XC96921: 0
2026-03-28 05:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:38:59 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9199 | hits on page: 40
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-28 05:38:59 [auto1.de] INFO: Scrape type for BZ86499: 2
2026-03-28 05:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-28 05:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5dd392-befd-5b3a-998f-9814cfb75955 with scrape type 2
2026-03-28 05:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5dd392-befd-5b3a-998f-9814cfb75955 with scrape type 2
2026-03-28 05:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5dd392-befd-5b3a-998f-9814cfb75955, identifier: BZ86499
2026-03-28 05:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-28 05:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-28 05:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499 to the API
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:57:51Z',
 'fuel_type': 'petrol',
 'id': 'dd5dd392-befd-5b3a-998f-9814cfb75955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ86499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 34079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-28 05:38:59 [auto1.de] INFO: Saving data for BZ86499: {'auction_closing_time': 1774717071.0, 'created_time': 1774552609.543102, 'last_price_update_time': 1774676339.940762}
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ86499') HTTP/1.1" 204 0
2026-03-28 05:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-28 05:38:59 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41570%27 HTTP/1.1" 200 None
2026-03-28 05:38:59 [auto1.de] INFO: Scrape type for MJ41570: 2
2026-03-28 05:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with identifier: MJ41570
2026-03-28 05:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with scrape type 2
2026-03-28 05:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with scrape type 2
2026-03-28 05:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 126fe7e2-a8f6-594d-b0c4-f1a5e6852032, identifier: MJ41570
2026-03-28 05:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with identifier: MJ41570
2026-03-28 05:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with identifier: MJ41570
2026-03-28 05:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 126fe7e2-a8f6-594d-b0c4-f1a5e6852032 with identifier: MJ41570 to the API
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:22:10Z',
 'fuel_type': 'petrol',
 'id': '126fe7e2-a8f6-594d-b0c4-f1a5e6852032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ41570',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 119283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 170',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41570%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Saving data for MJ41570: {'auction_closing_time': 1774714930.0, 'created_time': 1773830434.051128, 'last_price_update_time': 1774676340.419906}
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ41570') HTTP/1.1" 204 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: AT21596
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: ME93940
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK82561%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for CK82561: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84290%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for HH84290: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP33469%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for RP33469: 0
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-28 05:39:00 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-28 05:39:00 [auto1.de] INFO: Scrape type for ND67175: 2
2026-03-28 05:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-28 05:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6416f1e6-b60c-57c9-baca-781a0d296df5 with scrape type 2
2026-03-28 05:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6416f1e6-b60c-57c9-baca-781a0d296df5 with scrape type 2
2026-03-28 05:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6416f1e6-b60c-57c9-baca-781a0d296df5, identifier: ND67175
2026-03-28 05:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-28 05:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-28 05:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175 to the API
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-28T16:40:09Z',
 'fuel_type': 'diesel',
 'id': '6416f1e6-b60c-57c9-baca-781a0d296df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND67175',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 213407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Saving data for ND67175: {'auction_closing_time': 1774716009.0, 'created_time': 1774552742.068146, 'last_price_update_time': 1774676341.040017}
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND67175') HTTP/1.1" 204 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV81276%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for XV81276: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB82349%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for AB82349: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for FK98396: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for KH38301: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25301%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for GW25301: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS74430%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for DS74430: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE49775%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for GE49775: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN20653%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for KN20653: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65799%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for ZM65799: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX57791%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for SX57791: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for DV41165: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for TP63692: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD46189%27 HTTP/1.1" 200 None
2026-03-28 05:39:01 [auto1.de] INFO: Scrape type for LD46189: 0
2026-03-28 05:39:01 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-28 05:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:02 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE39544%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Scrape type for XE39544: 2
2026-03-28 05:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a49da74-033a-5b8e-b816-429f6ab3711e with identifier: XE39544
2026-03-28 05:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a49da74-033a-5b8e-b816-429f6ab3711e with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a49da74-033a-5b8e-b816-429f6ab3711e with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a49da74-033a-5b8e-b816-429f6ab3711e, identifier: XE39544
2026-03-28 05:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a49da74-033a-5b8e-b816-429f6ab3711e with identifier: XE39544
2026-03-28 05:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a49da74-033a-5b8e-b816-429f6ab3711e with identifier: XE39544
2026-03-28 05:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a49da74-033a-5b8e-b816-429f6ab3711e with identifier: XE39544 to the API
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:00:54Z',
 'fuel_type': 'diesel',
 'id': '8a49da74-033a-5b8e-b816-429f6ab3711e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE39544',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 76005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 435 L4 BlueHDi 160',
 'transmission': 'manual',
 'trim': '435 L4 BlueHDi 160',
 'year': 2017}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE39544%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Saving data for XE39544: {'auction_closing_time': 1774713654.0, 'created_time': 1773304176.392603, 'last_price_update_time': 1774676342.698135}
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE39544') HTTP/1.1" 204 0
2026-03-28 05:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:02 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-28 05:39:02 [auto1.de] INFO: Scrape type for CF62011: 2
2026-03-28 05:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-28 05:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0605991-f0b8-542c-981b-c40ce1c6bd44 with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0605991-f0b8-542c-981b-c40ce1c6bd44 with scrape type 2
2026-03-28 05:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0605991-f0b8-542c-981b-c40ce1c6bd44, identifier: CF62011
2026-03-28 05:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-28 05:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-28 05:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011 to the API
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:08Z',
 'fuel_type': 'petrol',
 'id': 'e0605991-f0b8-542c-981b-c40ce1c6bd44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF62011',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 156329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Seat Altea 1.4 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Saving data for CF62011: {'auction_closing_time': 1774716488.0, 'created_time': 1774552692.850183, 'last_price_update_time': 1774676343.258253}
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF62011') HTTP/1.1" 204 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE09477%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for UE09477: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH91659%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for PH91659: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for DR32988: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for DV40482: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR52184%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for AR52184: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK90168%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for JK90168: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for BR02529: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV84209%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for VV84209: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW23969%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for EW23969: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for PS41324: 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ38460%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Scrape type for MJ38460: 2
2026-03-28 05:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94372c87-8828-5346-8b15-7ec1d5613323 with identifier: MJ38460
2026-03-28 05:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94372c87-8828-5346-8b15-7ec1d5613323 with scrape type 2
2026-03-28 05:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94372c87-8828-5346-8b15-7ec1d5613323 with scrape type 2
2026-03-28 05:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94372c87-8828-5346-8b15-7ec1d5613323, identifier: MJ38460
2026-03-28 05:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94372c87-8828-5346-8b15-7ec1d5613323 with identifier: MJ38460
2026-03-28 05:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94372c87-8828-5346-8b15-7ec1d5613323 with identifier: MJ38460
2026-03-28 05:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94372c87-8828-5346-8b15-7ec1d5613323 with identifier: MJ38460 to the API
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:57:43Z',
 'fuel_type': 'hybrid',
 'id': '94372c87-8828-5346-8b15-7ec1d5613323',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ38460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 48076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-03',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ38460%27 HTTP/1.1" 200 None
2026-03-28 05:39:03 [auto1.de] INFO: Saving data for MJ38460: {'auction_closing_time': 1774717063.0, 'created_time': 1774463904.40701, 'last_price_update_time': 1774676343.890319}
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ38460') HTTP/1.1" 204 0
2026-03-28 05:39:03 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC93229%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for JC93229: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46905%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for LU46905: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83266%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for RL83266: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for TR42945: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN09274%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for UN09274: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43150%27 HTTP/1.1" 200 None
2026-03-28 05:39:04 [auto1.de] INFO: Scrape type for KH43150: 0
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-28 05:39:04 [auto1.de] INFO: Found listing with ID: PY53054
2026-03-28 05:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:05 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for BZ51273: 2
2026-03-28 05:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-28 05:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 525b7d66-c5f9-5b1a-87be-53b15f44a426 with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 525b7d66-c5f9-5b1a-87be-53b15f44a426 with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 525b7d66-c5f9-5b1a-87be-53b15f44a426, identifier: BZ51273
2026-03-28 05:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-28 05:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273
2026-03-28 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 525b7d66-c5f9-5b1a-87be-53b15f44a426 with identifier: BZ51273 to the API
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': '525b7d66-c5f9-5b1a-87be-53b15f44a426',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ51273',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 174293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Saving data for BZ51273: {'auction_closing_time': 1774715123.0, 'created_time': 1774463872.703445, 'last_price_update_time': 1774676345.449004}
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ51273') HTTP/1.1" 204 0
2026-03-28 05:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV36698%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for MV36698: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83523%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for GR83523: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: XA01561
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD86845%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for JD86845: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX79800%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for FX79800: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG57248%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for AG57248: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for RM09243: 0
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-28 05:39:05 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-28 05:39:05 [auto1.de] INFO: Scrape type for PV27021: 2
2026-03-28 05:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-28 05:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591715ae-761e-5767-ba64-3f563f5f9da5 with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591715ae-761e-5767-ba64-3f563f5f9da5 with scrape type 2
2026-03-28 05:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591715ae-761e-5767-ba64-3f563f5f9da5, identifier: PV27021
2026-03-28 05:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-28 05:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-28 05:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021 to the API
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:48:32Z',
 'fuel_type': 'diesel',
 'id': '591715ae-761e-5767-ba64-3f563f5f9da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV27021',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 161836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Saving data for PV27021: {'auction_closing_time': 1774716512.0, 'created_time': 1774552809.127063, 'last_price_update_time': 1774676346.11289}
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV27021') HTTP/1.1" 204 0
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Scrape type for WD01270: 0
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Scrape type for CS93004: 2
2026-03-28 05:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-28 05:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8148879-fde0-5d7c-8be4-dc345a13130a with scrape type 2
2026-03-28 05:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8148879-fde0-5d7c-8be4-dc345a13130a with scrape type 2
2026-03-28 05:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8148879-fde0-5d7c-8be4-dc345a13130a, identifier: CS93004
2026-03-28 05:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-28 05:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-28 05:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004 to the API
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:18Z',
 'fuel_type': 'diesel',
 'id': 'a8148879-fde0-5d7c-8be4-dc345a13130a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS93004',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 41003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2019}
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Saving data for CS93004: {'auction_closing_time': 1774715118.0, 'created_time': 1774553209.487423, 'last_price_update_time': 1774676346.71046}
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS93004') HTTP/1.1" 204 0
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 05:39:06 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-28 05:39:06 [auto1.de] INFO: Scrape type for XZ96479: 2
2026-03-28 05:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-28 05:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with scrape type 2
2026-03-28 05:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with scrape type 2
2026-03-28 05:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf, identifier: XZ96479
2026-03-28 05:39:06 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 14 pages/min), scraped 250 items (at 73 items/min)
2026-03-28 05:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-28 05:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-28 05:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479 to the API
2026-03-28 05:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:07:46Z',
 'fuel_type': 'diesel',
 'id': 'fa7f74cf-47e3-56a3-b5ab-3df69a1848cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ96479',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 284082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Saving data for XZ96479: {'auction_closing_time': 1774714066.0, 'created_time': 1774463873.912606, 'last_price_update_time': 1774676347.191335}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ96479') HTTP/1.1" 204 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for JY21775: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for UM76387: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for DX42832: 2
2026-03-28 05:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-28 05:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 962deb33-63f3-52ac-95aa-20ddc07a4d98 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 962deb33-63f3-52ac-95aa-20ddc07a4d98 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 962deb33-63f3-52ac-95aa-20ddc07a4d98, identifier: DX42832
2026-03-28 05:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-28 05:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-28 05:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832 to the API
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:46:19Z',
 'fuel_type': 'diesel',
 'id': '962deb33-63f3-52ac-95aa-20ddc07a4d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX42832',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 209732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Saving data for DX42832: {'auction_closing_time': 1774716379.0, 'created_time': 1774552923.957043, 'last_price_update_time': 1774676347.693356}
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX42832') HTTP/1.1" 204 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50208%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for XS50208: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ65813%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for RZ65813: 0
2026-03-28 05:39:07 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ50840%27 HTTP/1.1" 200 None
2026-03-28 05:39:07 [auto1.de] INFO: Scrape type for BZ50840: 2
2026-03-28 05:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95996ed-34a0-5e56-a2d9-e958a266a4d4 with identifier: BZ50840
2026-03-28 05:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95996ed-34a0-5e56-a2d9-e958a266a4d4 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95996ed-34a0-5e56-a2d9-e958a266a4d4 with scrape type 2
2026-03-28 05:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e95996ed-34a0-5e56-a2d9-e958a266a4d4, identifier: BZ50840
2026-03-28 05:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e95996ed-34a0-5e56-a2d9-e958a266a4d4 with identifier: BZ50840
2026-03-28 05:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e95996ed-34a0-5e56-a2d9-e958a266a4d4 with identifier: BZ50840
2026-03-28 05:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e95996ed-34a0-5e56-a2d9-e958a266a4d4 with identifier: BZ50840 to the API
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:43Z',
 'fuel_type': 'diesel',
 'id': 'e95996ed-34a0-5e56-a2d9-e958a266a4d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ50840',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 181251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ50840%27 HTTP/1.1" 200 None
2026-03-28 05:39:08 [auto1.de] INFO: Saving data for BZ50840: {'auction_closing_time': 1774717003.0, 'created_time': 1774466672.609904, 'last_price_update_time': 1774676348.289906}
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ50840') HTTP/1.1" 204 0
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR80743%27 HTTP/1.1" 200 None
2026-03-28 05:39:08 [auto1.de] INFO: Scrape type for AR80743: 0
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: FE77986
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-28 05:39:08 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-28 05:39:08 [auto1.de] INFO: Scrape type for XY25128: 2
2026-03-28 05:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-28 05:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fadb8330-8377-5d16-b16e-2cb8fdaad055 with scrape type 2
2026-03-28 05:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fadb8330-8377-5d16-b16e-2cb8fdaad055 with scrape type 2
2026-03-28 05:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fadb8330-8377-5d16-b16e-2cb8fdaad055, identifier: XY25128
2026-03-28 05:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-28 05:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-28 05:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128 to the API
2026-03-28 05:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:19:33Z',
 'fuel_type': 'diesel',
 'id': 'fadb8330-8377-5d16-b16e-2cb8fdaad055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY25128',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 167418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-15',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium blue 4WD',
 'transmission': 'automatic',
 'trim': 'Premium blue 4WD',
 'year': 2017}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-28 05:39:09 [auto1.de] INFO: Saving data for XY25128: {'auction_closing_time': 1774714773.0, 'created_time': 1774550657.378972, 'last_price_update_time': 1774676349.415433}
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY25128') HTTP/1.1" 204 0
2026-03-28 05:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:10 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW93148%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for EW93148: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11233%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for ZN11233: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08351%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for ME08351: 0
2026-03-28 05:39:10 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Scrape type for DK08351: 2
2026-03-28 05:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-28 05:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922715e1-e36f-53c5-8977-0cf184105e11 with scrape type 2
2026-03-28 05:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 922715e1-e36f-53c5-8977-0cf184105e11 with scrape type 2
2026-03-28 05:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 922715e1-e36f-53c5-8977-0cf184105e11, identifier: DK08351
2026-03-28 05:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-28 05:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-28 05:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351 to the API
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:52Z',
 'fuel_type': 'diesel',
 'id': '922715e1-e36f-53c5-8977-0cf184105e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK08351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 183991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-09',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Style BlueMotion',
 'transmission': 'automatic',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-28 05:39:10 [auto1.de] INFO: Saving data for DK08351: {'auction_closing_time': 1774715812.0, 'created_time': 1774464292.540328, 'last_price_update_time': 1774676350.995885}
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK08351') HTTP/1.1" 204 0
2026-03-28 05:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: YG22612
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG22612%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for YG22612: 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for AY25775: 2
2026-03-28 05:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-28 05:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b436ec-7ff9-5ad6-af48-540feca470ce with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90b436ec-7ff9-5ad6-af48-540feca470ce with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90b436ec-7ff9-5ad6-af48-540feca470ce, identifier: AY25775
2026-03-28 05:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-28 05:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-28 05:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775 to the API
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:17:06Z',
 'fuel_type': 'petrol',
 'id': '90b436ec-7ff9-5ad6-af48-540feca470ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY25775',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 62595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Saving data for AY25775: {'auction_closing_time': 1774714626.0, 'created_time': 1774553211.838748, 'last_price_update_time': 1774676351.483976}
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY25775') HTTP/1.1" 204 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for UZ22488: 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for CT54176: 2
2026-03-28 05:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-28 05:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b6db25-4440-5769-8d0c-e707a90dcf38 with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b6db25-4440-5769-8d0c-e707a90dcf38 with scrape type 2
2026-03-28 05:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55b6db25-4440-5769-8d0c-e707a90dcf38, identifier: CT54176
2026-03-28 05:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-28 05:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176
2026-03-28 05:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55b6db25-4440-5769-8d0c-e707a90dcf38 with identifier: CT54176 to the API
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:21:25Z',
 'fuel_type': 'petrol',
 'id': '55b6db25-4440-5769-8d0c-e707a90dcf38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT54176',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 93479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Saving data for CT54176: {'auction_closing_time': 1774714885.0, 'created_time': 1774467645.367171, 'last_price_update_time': 1774676351.944889}
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT54176') HTTP/1.1" 204 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-28 05:39:11 [auto1.de] INFO: Scrape type for YZ92306: 0
2026-03-28 05:39:11 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA68427%27 HTTP/1.1" 200 None
2026-03-28 05:39:12 [auto1.de] INFO: Scrape type for NA68427: 0
2026-03-28 05:39:12 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-28 05:39:12 [auto1.de] INFO: Scrape type for LS63557: 2
2026-03-28 05:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-28 05:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with scrape type 2
2026-03-28 05:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with scrape type 2
2026-03-28 05:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77, identifier: LS63557
2026-03-28 05:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-28 05:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-28 05:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557 to the API
2026-03-28 05:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:23:34Z',
 'fuel_type': 'diesel',
 'id': '4fe2c16f-59ab-534b-a26b-810dd8bc3a77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS63557',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 102470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Saving data for LS63557: {'auction_closing_time': 1774715014.0, 'created_time': 1774550704.922733, 'last_price_update_time': 1774676353.372868}
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS63557') HTTP/1.1" 204 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ67786%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for GZ67786: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK25728%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for RK25728: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71174%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for GE71174: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for YR16927: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD64872%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for TD64872: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH83950%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for VH83950: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS89362%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for CS89362: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK72669%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for BK72669: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN89547%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for SN89547: 0
2026-03-28 05:39:13 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX39487%27 HTTP/1.1" 200 None
2026-03-28 05:39:13 [auto1.de] INFO: Scrape type for JX39487: 0
2026-03-28 05:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:14 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-28 05:39:14 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-28 05:39:14 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-28 05:39:14 [auto1.de] INFO: Scrape type for PP25437: 2
2026-03-28 05:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-28 05:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3329d6-5c1b-5861-903f-9e4044847474 with scrape type 2
2026-03-28 05:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3329d6-5c1b-5861-903f-9e4044847474 with scrape type 2
2026-03-28 05:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc3329d6-5c1b-5861-903f-9e4044847474, identifier: PP25437
2026-03-28 05:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-28 05:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-28 05:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437 to the API
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:26:42Z',
 'fuel_type': 'petrol',
 'id': 'fc3329d6-5c1b-5861-903f-9e4044847474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP25437',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 89071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-28 05:39:14 [auto1.de] INFO: Saving data for PP25437: {'auction_closing_time': 1774715202.0, 'created_time': 1774551209.625397, 'last_price_update_time': 1774676354.934639}
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP25437') HTTP/1.1" 204 0
2026-03-28 05:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC97573%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for JC97573: 2
2026-03-28 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abfcbcc0-d932-571c-b5af-ffc603cd0d5c with identifier: JC97573
2026-03-28 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfcbcc0-d932-571c-b5af-ffc603cd0d5c with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abfcbcc0-d932-571c-b5af-ffc603cd0d5c with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abfcbcc0-d932-571c-b5af-ffc603cd0d5c, identifier: JC97573
2026-03-28 05:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abfcbcc0-d932-571c-b5af-ffc603cd0d5c with identifier: JC97573
2026-03-28 05:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abfcbcc0-d932-571c-b5af-ffc603cd0d5c with identifier: JC97573
2026-03-28 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abfcbcc0-d932-571c-b5af-ffc603cd0d5c with identifier: JC97573 to the API
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:40:34Z',
 'fuel_type': 'diesel',
 'id': 'abfcbcc0-d932-571c-b5af-ffc603cd0d5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC97573',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 58363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2018}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC97573%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Saving data for JC97573: {'auction_closing_time': 1774716034.0, 'created_time': 1773861302.634824, 'last_price_update_time': 1774676355.456929}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC97573') HTTP/1.1" 204 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for UV60068: 2
2026-03-28 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-28 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ca0116-b85c-5423-9000-236cf05d2bcb with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ca0116-b85c-5423-9000-236cf05d2bcb with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42ca0116-b85c-5423-9000-236cf05d2bcb, identifier: UV60068
2026-03-28 05:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-28 05:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-28 05:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068 to the API
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:32:38Z',
 'fuel_type': 'gas',
 'id': '42ca0116-b85c-5423-9000-236cf05d2bcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV60068',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 71694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Saving data for UV60068: {'auction_closing_time': 1774715558.0, 'created_time': 1773132238.159153, 'last_price_update_time': 1774676355.885182}
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV60068') HTTP/1.1" 204 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV13467%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for UV13467: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX19676%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for RX19676: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for LE88532: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG99162%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for ZG99162: 0
2026-03-28 05:39:15 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47833%27 HTTP/1.1" 200 None
2026-03-28 05:39:15 [auto1.de] INFO: Scrape type for YT47833: 2
2026-03-28 05:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f77c0360-84ae-5f17-acc0-1bc70e6414ab with identifier: YT47833
2026-03-28 05:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f77c0360-84ae-5f17-acc0-1bc70e6414ab with scrape type 2
2026-03-28 05:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f77c0360-84ae-5f17-acc0-1bc70e6414ab with scrape type 2
2026-03-28 05:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f77c0360-84ae-5f17-acc0-1bc70e6414ab, identifier: YT47833
2026-03-28 05:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f77c0360-84ae-5f17-acc0-1bc70e6414ab with identifier: YT47833
2026-03-28 05:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f77c0360-84ae-5f17-acc0-1bc70e6414ab with identifier: YT47833
2026-03-28 05:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f77c0360-84ae-5f17-acc0-1bc70e6414ab with identifier: YT47833 to the API
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:14:11Z',
 'fuel_type': 'petrol',
 'id': 'f77c0360-84ae-5f17-acc0-1bc70e6414ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT47833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 86852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47833%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Saving data for YT47833: {'auction_closing_time': 1774714451.0, 'created_time': 1774466887.328133, 'last_price_update_time': 1774676356.446533}
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT47833') HTTP/1.1" 204 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV51818%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for VV51818: 0
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-28 05:39:16 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW54945%27 HTTP/1.1" 200 None
2026-03-28 05:39:16 [auto1.de] INFO: Scrape type for WW54945: 2
2026-03-28 05:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with identifier: WW54945
2026-03-28 05:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with scrape type 2
2026-03-28 05:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with scrape type 2
2026-03-28 05:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe, identifier: WW54945
2026-03-28 05:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with identifier: WW54945
2026-03-28 05:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with identifier: WW54945
2026-03-28 05:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe with identifier: WW54945 to the API
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:28:43Z',
 'fuel_type': 'petrol',
 'id': '7f2ffa8a-b3ae-5e7e-8dca-6abc34966dbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW54945',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 90016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 TCe Energy Crossborder',
 'transmission': 'manual',
 'trim': 'Crossborder',
 'year': 2017}
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW54945%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Saving data for WW54945: {'auction_closing_time': 1774715323.0, 'created_time': 1774552874.530641, 'last_price_update_time': 1774676357.023667}
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW54945') HTTP/1.1" 204 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC87687%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for NC87687: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for FF39586: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL27695%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for EL27695: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for ND00067: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF09358%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for ZF09358: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL53534%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for AL53534: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK52280%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for MK52280: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH96479%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for TH96479: 2
2026-03-28 05:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e60782-11b3-5ba5-81a4-9943738b47bf with identifier: TH96479
2026-03-28 05:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e60782-11b3-5ba5-81a4-9943738b47bf with scrape type 2
2026-03-28 05:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e60782-11b3-5ba5-81a4-9943738b47bf with scrape type 2
2026-03-28 05:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e60782-11b3-5ba5-81a4-9943738b47bf, identifier: TH96479
2026-03-28 05:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e60782-11b3-5ba5-81a4-9943738b47bf with identifier: TH96479
2026-03-28 05:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e60782-11b3-5ba5-81a4-9943738b47bf with identifier: TH96479
2026-03-28 05:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e60782-11b3-5ba5-81a4-9943738b47bf with identifier: TH96479 to the API
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:06:40Z',
 'fuel_type': 'diesel',
 'id': 'c9e60782-11b3-5ba5-81a4-9943738b47bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH96479',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 230529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-10',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2016}
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH96479%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Saving data for TH96479: {'auction_closing_time': 1774714000.0, 'created_time': 1774467670.606383, 'last_price_update_time': 1774676357.585998}
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH96479') HTTP/1.1" 204 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY87386%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for HY87386: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF90097%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for AF90097: 0
2026-03-28 05:39:17 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ17968%27 HTTP/1.1" 200 None
2026-03-28 05:39:17 [auto1.de] INFO: Scrape type for HZ17968: 2
2026-03-28 05:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f3a9e4-260f-544e-800a-9f5c2318e216 with identifier: HZ17968
2026-03-28 05:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f3a9e4-260f-544e-800a-9f5c2318e216 with scrape type 2
2026-03-28 05:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f3a9e4-260f-544e-800a-9f5c2318e216 with scrape type 2
2026-03-28 05:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f3a9e4-260f-544e-800a-9f5c2318e216, identifier: HZ17968
2026-03-28 05:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f3a9e4-260f-544e-800a-9f5c2318e216 with identifier: HZ17968
2026-03-28 05:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f3a9e4-260f-544e-800a-9f5c2318e216 with identifier: HZ17968
2026-03-28 05:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f3a9e4-260f-544e-800a-9f5c2318e216 with identifier: HZ17968 to the API
2026-03-28 05:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:50Z',
 'fuel_type': 'diesel',
 'id': 'c7f3a9e4-260f-544e-800a-9f5c2318e216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ17968',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 335256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-14',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ17968%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Saving data for HZ17968: {'auction_closing_time': 1774716410.0, 'created_time': 1774552465.307505, 'last_price_update_time': 1774676358.140384}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ17968') HTTP/1.1" 204 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for JM70147: 2
2026-03-28 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-28 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8, identifier: JM70147
2026-03-28 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-28 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-28 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147 to the API
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:20:31Z',
 'fuel_type': 'petrol',
 'id': 'ed7e6a5f-2cdd-5892-b866-d307ed17d9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM70147',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 64942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-15',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2006}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Saving data for JM70147: {'auction_closing_time': 1774714831.0, 'created_time': 1774553075.941197, 'last_price_update_time': 1774676358.593898}
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM70147') HTTP/1.1" 204 0
2026-03-28 05:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN69467%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for AN69467: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX66277%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for VX66277: 0
2026-03-28 05:39:18 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: BB75752
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB75752%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for BB75752: 0
2026-03-28 05:39:18 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB10929%27 HTTP/1.1" 200 None
2026-03-28 05:39:18 [auto1.de] INFO: Scrape type for RB10929: 2
2026-03-28 05:39:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca4fae9b-f8ec-5682-a082-07e8a655d072 with identifier: RB10929
2026-03-28 05:39:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca4fae9b-f8ec-5682-a082-07e8a655d072 with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca4fae9b-f8ec-5682-a082-07e8a655d072 with scrape type 2
2026-03-28 05:39:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca4fae9b-f8ec-5682-a082-07e8a655d072, identifier: RB10929
2026-03-28 05:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca4fae9b-f8ec-5682-a082-07e8a655d072 with identifier: RB10929
2026-03-28 05:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca4fae9b-f8ec-5682-a082-07e8a655d072 with identifier: RB10929
2026-03-28 05:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca4fae9b-f8ec-5682-a082-07e8a655d072 with identifier: RB10929 to the API
2026-03-28 05:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:13:48Z',
 'fuel_type': 'petrol',
 'id': 'ca4fae9b-f8ec-5682-a082-07e8a655d072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB10929',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB10929%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Saving data for RB10929: {'auction_closing_time': 1774714428.0, 'created_time': 1773946249.887839, 'last_price_update_time': 1774676359.145033}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB10929') HTTP/1.1" 204 0
2026-03-28 05:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for EL15513: 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for BE37865: 2
2026-03-28 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-28 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21a91ea-0db2-5256-9edd-d303bfbe78c3 with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21a91ea-0db2-5256-9edd-d303bfbe78c3 with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d21a91ea-0db2-5256-9edd-d303bfbe78c3, identifier: BE37865
2026-03-28 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-28 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-28 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865 to the API
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:59:23Z',
 'fuel_type': 'petrol',
 'id': 'd21a91ea-0db2-5256-9edd-d303bfbe78c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE37865',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 96528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Saving data for BE37865: {'auction_closing_time': 1774717163.0, 'created_time': 1774552613.773653, 'last_price_update_time': 1774676359.738942}
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE37865') HTTP/1.1" 204 0
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 05:39:19 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-28 05:39:19 [auto1.de] INFO: Scrape type for AA02117: 2
2026-03-28 05:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-28 05:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae143b27-e226-51c8-be39-903618b36b63 with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae143b27-e226-51c8-be39-903618b36b63 with scrape type 2
2026-03-28 05:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae143b27-e226-51c8-be39-903618b36b63, identifier: AA02117
2026-03-28 05:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-28 05:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-28 05:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117 to the API
2026-03-28 05:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:28:38Z',
 'fuel_type': 'petrol',
 'id': 'ae143b27-e226-51c8-be39-903618b36b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA02117',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 219730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2015}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Saving data for AA02117: {'auction_closing_time': 1774715318.0, 'created_time': 1774551658.343198, 'last_price_update_time': 1774676360.196532}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA02117') HTTP/1.1" 204 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for SJ86823: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ80184%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for XZ80184: 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA96250%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for XA96250: 2
2026-03-28 05:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with identifier: XA96250
2026-03-28 05:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with scrape type 2
2026-03-28 05:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with scrape type 2
2026-03-28 05:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48588c8f-5c35-5246-ad0a-7f53e7c8db22, identifier: XA96250
2026-03-28 05:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with identifier: XA96250
2026-03-28 05:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with identifier: XA96250
2026-03-28 05:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48588c8f-5c35-5246-ad0a-7f53e7c8db22 with identifier: XA96250 to the API
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'petrol',
 'id': '48588c8f-5c35-5246-ad0a-7f53e7c8db22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA96250',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 136063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA96250%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Saving data for XA96250: {'auction_closing_time': 1774713753.0, 'created_time': 1773308250.770852, 'last_price_update_time': 1774676360.682832}
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA96250') HTTP/1.1" 204 0
2026-03-28 05:39:20 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP31336%27 HTTP/1.1" 200 None
2026-03-28 05:39:20 [auto1.de] INFO: Scrape type for AP31336: 2
2026-03-28 05:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89101059-6d1c-5b48-8e31-5b7112664f2f with identifier: AP31336
2026-03-28 05:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89101059-6d1c-5b48-8e31-5b7112664f2f with scrape type 2
2026-03-28 05:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89101059-6d1c-5b48-8e31-5b7112664f2f with scrape type 2
2026-03-28 05:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89101059-6d1c-5b48-8e31-5b7112664f2f, identifier: AP31336
2026-03-28 05:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89101059-6d1c-5b48-8e31-5b7112664f2f with identifier: AP31336
2026-03-28 05:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89101059-6d1c-5b48-8e31-5b7112664f2f with identifier: AP31336
2026-03-28 05:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89101059-6d1c-5b48-8e31-5b7112664f2f with identifier: AP31336 to the API
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:38:58Z',
 'fuel_type': 'diesel',
 'id': '89101059-6d1c-5b48-8e31-5b7112664f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP31336',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 126223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP31336%27 HTTP/1.1" 200 None
2026-03-28 05:39:21 [auto1.de] INFO: Saving data for AP31336: {'auction_closing_time': 1774715938.0, 'created_time': 1774467427.466581, 'last_price_update_time': 1774676361.239561}
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP31336') HTTP/1.1" 204 0
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14314%27 HTTP/1.1" 200 None
2026-03-28 05:39:21 [auto1.de] INFO: Scrape type for JH14314: 2
2026-03-28 05:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with identifier: JH14314
2026-03-28 05:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with scrape type 2
2026-03-28 05:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with scrape type 2
2026-03-28 05:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15d706c4-b55f-5bf5-bd94-2cc41d96e876, identifier: JH14314
2026-03-28 05:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with identifier: JH14314
2026-03-28 05:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with identifier: JH14314
2026-03-28 05:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15d706c4-b55f-5bf5-bd94-2cc41d96e876 with identifier: JH14314 to the API
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:12:52Z',
 'fuel_type': 'petrol',
 'id': '15d706c4-b55f-5bf5-bd94-2cc41d96e876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH14314',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 147918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2009}
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14314%27 HTTP/1.1" 200 None
2026-03-28 05:39:21 [auto1.de] INFO: Saving data for JH14314: {'auction_closing_time': 1774714372.0, 'created_time': 1774552823.678106, 'last_price_update_time': 1774676361.675545}
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH14314') HTTP/1.1" 204 0
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 05:39:21 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-28 05:39:21 [auto1.de] INFO: Scrape type for FJ59032: 2
2026-03-28 05:39:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-28 05:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with scrape type 2
2026-03-28 05:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with scrape type 2
2026-03-28 05:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3df8a99-d70a-56e6-bf5e-e9c24c16b327, identifier: FJ59032
2026-03-28 05:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-28 05:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-28 05:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032 to the API
2026-03-28 05:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'petrol',
 'id': 'a3df8a99-d70a-56e6-bf5e-e9c24c16b327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ59032',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 131065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-18',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Saving data for FJ59032: {'auction_closing_time': 1774715096.0, 'created_time': 1774552669.187664, 'last_price_update_time': 1774676362.149125}
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ59032') HTTP/1.1" 204 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for JB80015: 2
2026-03-28 05:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-28 05:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8109904a-f3f8-5b13-b734-9ac3cba101c0 with scrape type 2
2026-03-28 05:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8109904a-f3f8-5b13-b734-9ac3cba101c0 with scrape type 2
2026-03-28 05:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8109904a-f3f8-5b13-b734-9ac3cba101c0, identifier: JB80015
2026-03-28 05:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-28 05:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-28 05:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015 to the API
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:10:19Z',
 'fuel_type': 'petrol',
 'id': '8109904a-f3f8-5b13-b734-9ac3cba101c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB80015',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 227451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Saving data for JB80015: {'auction_closing_time': 1774714219.0, 'created_time': 1774551449.937392, 'last_price_update_time': 1774676362.563251}
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB80015') HTTP/1.1" 204 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD61316%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for WD61316: 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for WH58707: 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW97387%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for HW97387: 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB35688%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for EB35688: 0
2026-03-28 05:39:22 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-28 05:39:22 [auto1.de] INFO: Scrape type for GZ76571: 2
2026-03-28 05:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-28 05:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with scrape type 2
2026-03-28 05:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with scrape type 2
2026-03-28 05:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0, identifier: GZ76571
2026-03-28 05:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-28 05:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-28 05:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571 to the API
2026-03-28 05:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:30Z',
 'fuel_type': 'diesel',
 'id': '6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ76571',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 193302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-05',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2013}
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Saving data for GZ76571: {'auction_closing_time': 1774714830.0, 'created_time': 1774552971.118067, 'last_price_update_time': 1774676363.194225}
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ76571') HTTP/1.1" 204 0
2026-03-28 05:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:23 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ28158%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for JZ28158: 0
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56250%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for LE56250: 0
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL04129%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for TL04129: 0
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-28 05:39:23 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Scrape type for DM07006: 2
2026-03-28 05:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-28 05:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with scrape type 2
2026-03-28 05:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with scrape type 2
2026-03-28 05:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96, identifier: DM07006
2026-03-28 05:39:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-28 05:39:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-28 05:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006 to the API
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:29Z',
 'fuel_type': 'diesel',
 'id': '47351ab2-ca2d-5b1b-96d7-09accc1a6e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM07006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 216692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Freestyle BlueMotion',
 'transmission': 'manual',
 'trim': 'Freestyle BlueMotion',
 'year': 2011}
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-28 05:39:23 [auto1.de] INFO: Saving data for DM07006: {'auction_closing_time': 1774716629.0, 'created_time': 1774552700.366709, 'last_price_update_time': 1774676363.926291}
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM07006') HTTP/1.1" 204 0
2026-03-28 05:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM28399%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for TM28399: 2
2026-03-28 05:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c9df358-4731-5044-8c59-d3facf01b302 with identifier: TM28399
2026-03-28 05:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c9df358-4731-5044-8c59-d3facf01b302 with scrape type 2
2026-03-28 05:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c9df358-4731-5044-8c59-d3facf01b302 with scrape type 2
2026-03-28 05:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c9df358-4731-5044-8c59-d3facf01b302, identifier: TM28399
2026-03-28 05:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c9df358-4731-5044-8c59-d3facf01b302 with identifier: TM28399
2026-03-28 05:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c9df358-4731-5044-8c59-d3facf01b302 with identifier: TM28399
2026-03-28 05:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c9df358-4731-5044-8c59-d3facf01b302 with identifier: TM28399 to the API
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-28T16:49:09Z',
 'fuel_type': 'petrol',
 'id': '0c9df358-4731-5044-8c59-d3facf01b302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM28399',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 96980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM28399%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Saving data for TM28399: {'auction_closing_time': 1774716549.0, 'created_time': 1774463893.89813, 'last_price_update_time': 1774676364.474468}
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM28399') HTTP/1.1" 204 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for DX26542: 2
2026-03-28 05:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-28 05:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c059361-6ecb-5275-82b1-d86bad0aa988 with scrape type 2
2026-03-28 05:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c059361-6ecb-5275-82b1-d86bad0aa988 with scrape type 2
2026-03-28 05:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c059361-6ecb-5275-82b1-d86bad0aa988, identifier: DX26542
2026-03-28 05:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-28 05:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-28 05:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542 to the API
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:36:59Z',
 'fuel_type': 'diesel',
 'id': '2c059361-6ecb-5275-82b1-d86bad0aa988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX26542',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 163924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-13',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2007}
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Saving data for DX26542: {'auction_closing_time': 1774715819.0, 'created_time': 1774467682.663177, 'last_price_update_time': 1774676364.957537}
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX26542') HTTP/1.1" 204 0
2026-03-28 05:39:24 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-28 05:39:24 [auto1.de] INFO: Scrape type for HM43288: 2
2026-03-28 05:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-28 05:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with scrape type 2
2026-03-28 05:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with scrape type 2
2026-03-28 05:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4e3f8b5-f9c2-5ebe-976c-296986d694e1, identifier: HM43288
2026-03-28 05:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-28 05:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-28 05:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288 to the API
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:54:22Z',
 'fuel_type': 'hybrid',
 'id': 'f4e3f8b5-f9c2-5ebe-976c-296986d694e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM43288',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 47832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Saving data for HM43288: {'auction_closing_time': 1774716862.0, 'created_time': 1774550992.961841, 'last_price_update_time': 1774676365.389009}
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM43288') HTTP/1.1" 204 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW92568%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for GW92568: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for WM91773: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00674%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for SF00674: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for GJ26621: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: US56828
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK11674%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for NK11674: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for CM53141: 0
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-28 05:39:25 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL09374%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Scrape type for KL09374: 2
2026-03-28 05:39:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd007bc2-3013-576d-86e1-6244008059c0 with identifier: KL09374
2026-03-28 05:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd007bc2-3013-576d-86e1-6244008059c0 with scrape type 2
2026-03-28 05:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd007bc2-3013-576d-86e1-6244008059c0 with scrape type 2
2026-03-28 05:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd007bc2-3013-576d-86e1-6244008059c0, identifier: KL09374
2026-03-28 05:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd007bc2-3013-576d-86e1-6244008059c0 with identifier: KL09374
2026-03-28 05:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd007bc2-3013-576d-86e1-6244008059c0 with identifier: KL09374
2026-03-28 05:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd007bc2-3013-576d-86e1-6244008059c0 with identifier: KL09374 to the API
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:53:13Z',
 'fuel_type': 'diesel',
 'id': 'cd007bc2-3013-576d-86e1-6244008059c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL09374',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 125233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-18',
 'seller_name': None,
 'title': 'BMW 1er 116d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL09374%27 HTTP/1.1" 200 None
2026-03-28 05:39:25 [auto1.de] INFO: Saving data for KL09374: {'auction_closing_time': 1774716793.0, 'created_time': 1773308141.15748, 'last_price_update_time': 1774676365.964419}
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL09374') HTTP/1.1" 204 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-28 05:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:26 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for YH55403: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for TP76478: 0
2026-03-28 05:39:26 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-28 05:39:26 [auto1.de] INFO: Scrape type for XB58662: 2
2026-03-28 05:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-28 05:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with scrape type 2
2026-03-28 05:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with scrape type 2
2026-03-28 05:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9, identifier: XB58662
2026-03-28 05:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-28 05:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-28 05:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662 to the API
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:05Z',
 'fuel_type': 'diesel',
 'id': 'a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB58662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 127954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2013}
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Saving data for XB58662: {'auction_closing_time': 1774716785.0, 'created_time': 1774552214.764045, 'last_price_update_time': 1774676367.37169}
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB58662') HTTP/1.1" 204 0
2026-03-28 05:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for HK09580: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for HN95943: 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Scrape type for HR12459: 2
2026-03-28 05:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-28 05:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 2
2026-03-28 05:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 2
2026-03-28 05:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79dba0d-9a6f-594c-853e-b12b81f7cf86, identifier: HR12459
2026-03-28 05:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-28 05:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-28 05:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459 to the API
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:02:33Z',
 'fuel_type': 'diesel',
 'id': 'b79dba0d-9a6f-594c-853e-b12b81f7cf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR12459',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 309344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-28 05:39:27 [auto1.de] INFO: Saving data for HR12459: {'auction_closing_time': 1774713753.0, 'created_time': 1773946005.349615, 'last_price_update_time': 1774676367.978268}
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR12459') HTTP/1.1" 204 0
2026-03-28 05:39:27 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for VK72696: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ50234%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for MJ50234: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP19217%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for WP19217: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51646%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for WA51646: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: FX28267
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for BG36952: 2
2026-03-28 05:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-28 05:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a82bd6a9-b789-5542-98e2-34c1f89070b2 with scrape type 2
2026-03-28 05:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a82bd6a9-b789-5542-98e2-34c1f89070b2 with scrape type 2
2026-03-28 05:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a82bd6a9-b789-5542-98e2-34c1f89070b2, identifier: BG36952
2026-03-28 05:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-28 05:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-28 05:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952 to the API
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-28T16:41:32Z',
 'fuel_type': 'diesel',
 'id': 'a82bd6a9-b789-5542-98e2-34c1f89070b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG36952',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 175392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-10',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2 Multispace Tendance',
 'transmission': 'manual',
 'trim': 'L2 Multispace Tendance',
 'year': 2014}
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Saving data for BG36952: {'auction_closing_time': 1774716092.0, 'created_time': 1774552343.264413, 'last_price_update_time': 1774676368.51556}
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG36952') HTTP/1.1" 204 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for ZL47575: 0
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 05:39:28 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY08690%27 HTTP/1.1" 200 None
2026-03-28 05:39:28 [auto1.de] INFO: Scrape type for EY08690: 2
2026-03-28 05:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce1f829-0692-5e93-a3df-91f7d9c4760f with identifier: EY08690
2026-03-28 05:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce1f829-0692-5e93-a3df-91f7d9c4760f with scrape type 2
2026-03-28 05:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce1f829-0692-5e93-a3df-91f7d9c4760f with scrape type 2
2026-03-28 05:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ce1f829-0692-5e93-a3df-91f7d9c4760f, identifier: EY08690
2026-03-28 05:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ce1f829-0692-5e93-a3df-91f7d9c4760f with identifier: EY08690
2026-03-28 05:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ce1f829-0692-5e93-a3df-91f7d9c4760f with identifier: EY08690
2026-03-28 05:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ce1f829-0692-5e93-a3df-91f7d9c4760f with identifier: EY08690 to the API
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:57:09Z',
 'fuel_type': 'petrol',
 'id': '4ce1f829-0692-5e93-a3df-91f7d9c4760f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY08690',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 120682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-22',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY08690%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Saving data for EY08690: {'auction_closing_time': 1774717029.0, 'created_time': 1774464013.387707, 'last_price_update_time': 1774676369.090104}
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY08690') HTTP/1.1" 204 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85769%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for VE85769: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31458%27 HTTP/1.1" 200 None
2026-03-28 05:39:29 [auto1.de] INFO: Scrape type for XT31458: 0
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 05:39:29 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 05:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:33 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for DS04882: 2
2026-03-28 05:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-28 05:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b821b196-a546-508b-a282-569c391b672d with scrape type 2
2026-03-28 05:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b821b196-a546-508b-a282-569c391b672d with scrape type 2
2026-03-28 05:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b821b196-a546-508b-a282-569c391b672d, identifier: DS04882
2026-03-28 05:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-28 05:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-28 05:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882 to the API
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:23:14Z',
 'fuel_type': 'diesel',
 'id': 'b821b196-a546-508b-a282-569c391b672d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS04882',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 255700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Saving data for DS04882: {'auction_closing_time': 1774714994.0, 'created_time': 1774552901.578613, 'last_price_update_time': 1774676373.475367}
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS04882') HTTP/1.1" 204 0
2026-03-28 05:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: ZU82710
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82710%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for ZU82710: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17067%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for AL17067: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE17641%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for WE17641: 0
2026-03-28 05:39:33 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Scrape type for LZ26330: 2
2026-03-28 05:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-28 05:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c4a5af-835e-59a4-bf6f-f03be9920f08 with scrape type 2
2026-03-28 05:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c4a5af-835e-59a4-bf6f-f03be9920f08 with scrape type 2
2026-03-28 05:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c4a5af-835e-59a4-bf6f-f03be9920f08, identifier: LZ26330
2026-03-28 05:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-28 05:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-28 05:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330 to the API
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'petrol',
 'id': 'b4c4a5af-835e-59a4-bf6f-f03be9920f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ26330',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 34369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-28 05:39:33 [auto1.de] INFO: Saving data for LZ26330: {'auction_closing_time': 1774717059.0, 'created_time': 1774553179.420278, 'last_price_update_time': 1774676373.978586}
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ26330') HTTP/1.1" 204 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT96701%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for NT96701: 2
2026-03-28 05:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with identifier: NT96701
2026-03-28 05:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with scrape type 2
2026-03-28 05:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with scrape type 2
2026-03-28 05:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f0c9561-ed9b-5e86-9f54-a7968c135af1, identifier: NT96701
2026-03-28 05:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with identifier: NT96701
2026-03-28 05:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with identifier: NT96701
2026-03-28 05:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f0c9561-ed9b-5e86-9f54-a7968c135af1 with identifier: NT96701 to the API
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:34:59Z',
 'fuel_type': 'diesel',
 'id': '2f0c9561-ed9b-5e86-9f54-a7968c135af1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT96701',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 248459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT96701%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Saving data for NT96701: {'auction_closing_time': 1774715699.0, 'created_time': 1774467898.594619, 'last_price_update_time': 1774676374.516328}
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT96701') HTTP/1.1" 204 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY92583%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for AY92583: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU29056%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for KU29056: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN10939%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for NN10939: 0
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 05:39:34 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-28 05:39:34 [auto1.de] INFO: Scrape type for GU60494: 2
2026-03-28 05:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-28 05:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a207d31-6587-5796-bfb2-bd812df8e139 with scrape type 2
2026-03-28 05:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a207d31-6587-5796-bfb2-bd812df8e139 with scrape type 2
2026-03-28 05:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a207d31-6587-5796-bfb2-bd812df8e139, identifier: GU60494
2026-03-28 05:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-28 05:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-28 05:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494 to the API
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:58Z',
 'fuel_type': 'petrol',
 'id': '0a207d31-6587-5796-bfb2-bd812df8e139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU60494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 104084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Saving data for GU60494: {'auction_closing_time': 1774714918.0, 'created_time': 1774552780.735016, 'last_price_update_time': 1774676375.0171}
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU60494') HTTP/1.1" 204 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF90818%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for VF90818: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for NY21217: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for SR56375: 2
2026-03-28 05:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-28 05:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df101a7e-34b9-56ea-b6ff-2e4f23c34818 with scrape type 2
2026-03-28 05:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df101a7e-34b9-56ea-b6ff-2e4f23c34818 with scrape type 2
2026-03-28 05:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df101a7e-34b9-56ea-b6ff-2e4f23c34818, identifier: SR56375
2026-03-28 05:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-28 05:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-28 05:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375 to the API
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:56Z',
 'fuel_type': 'diesel',
 'id': 'df101a7e-34b9-56ea-b6ff-2e4f23c34818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR56375',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 186937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Saving data for SR56375: {'auction_closing_time': 1774714916.0, 'created_time': 1774463883.203203, 'last_price_update_time': 1774676375.591832}
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR56375') HTTP/1.1" 204 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for RE71424: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW98427%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for XW98427: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD49679%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for HD49679: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK27317%27 HTTP/1.1" 200 None
2026-03-28 05:39:35 [auto1.de] INFO: Scrape type for DK27317: 0
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-28 05:39:35 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-28 05:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:36 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for FR24268: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT71403%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for UT71403: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL49213%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for LL49213: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for RM06492: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for FL79995: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-28 05:39:36 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG91199%27 HTTP/1.1" 200 None
2026-03-28 05:39:36 [auto1.de] INFO: Scrape type for MG91199: 2
2026-03-28 05:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with identifier: MG91199
2026-03-28 05:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with scrape type 2
2026-03-28 05:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with scrape type 2
2026-03-28 05:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f32772cf-bbe2-572b-92fd-907d3f8bc4c9, identifier: MG91199
2026-03-28 05:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with identifier: MG91199
2026-03-28 05:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with identifier: MG91199
2026-03-28 05:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f32772cf-bbe2-572b-92fd-907d3f8bc4c9 with identifier: MG91199 to the API
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:19:55Z',
 'fuel_type': 'diesel',
 'id': 'f32772cf-bbe2-572b-92fd-907d3f8bc4c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG91199',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 195898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Business-Line',
 'transmission': 'manual',
 'trim': 'Business-Line',
 'year': 2015}
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG91199%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Saving data for MG91199: {'auction_closing_time': 1774714795.0, 'created_time': 1774550600.179479, 'last_price_update_time': 1774676377.371276}
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG91199') HTTP/1.1" 204 0
2026-03-28 05:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC26208%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for MC26208: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: GJ57760
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ57760%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for GJ57760: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-28 05:39:37 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR86863%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Scrape type for XR86863: 2
2026-03-28 05:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02b52b47-e703-5f32-912e-d41bc40a088b with identifier: XR86863
2026-03-28 05:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02b52b47-e703-5f32-912e-d41bc40a088b with scrape type 2
2026-03-28 05:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02b52b47-e703-5f32-912e-d41bc40a088b with scrape type 2
2026-03-28 05:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02b52b47-e703-5f32-912e-d41bc40a088b, identifier: XR86863
2026-03-28 05:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02b52b47-e703-5f32-912e-d41bc40a088b with identifier: XR86863
2026-03-28 05:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02b52b47-e703-5f32-912e-d41bc40a088b with identifier: XR86863
2026-03-28 05:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02b52b47-e703-5f32-912e-d41bc40a088b with identifier: XR86863 to the API
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'diesel',
 'id': '02b52b47-e703-5f32-912e-d41bc40a088b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR86863',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 298500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Startline',
 'transmission': 'automatic',
 'trim': 'Startline',
 'year': 2008}
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR86863%27 HTTP/1.1" 200 None
2026-03-28 05:39:37 [auto1.de] INFO: Saving data for XR86863: {'auction_closing_time': 1774716492.0, 'created_time': 1774467566.782863, 'last_price_update_time': 1774676377.982467}
2026-03-28 05:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR86863') HTTP/1.1" 204 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for BE24372: 2
2026-03-28 05:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-28 05:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f75d988-e70b-5139-a934-b5c0e85a23e1 with scrape type 2
2026-03-28 05:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f75d988-e70b-5139-a934-b5c0e85a23e1 with scrape type 2
2026-03-28 05:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f75d988-e70b-5139-a934-b5c0e85a23e1, identifier: BE24372
2026-03-28 05:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-28 05:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-28 05:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372 to the API
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 550,
 'expiration_date': '2026-03-28T16:07:48Z',
 'fuel_type': 'petrol',
 'id': '2f75d988-e70b-5139-a934-b5c0e85a23e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE24372',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 115320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-14',
 'seller_name': None,
 'title': 'Porsche Cayenne Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Saving data for BE24372: {'auction_closing_time': 1774714068.0, 'created_time': 1774552774.700391, 'last_price_update_time': 1774676378.407503}
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE24372') HTTP/1.1" 204 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA60427%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for FA60427: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS11001%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for YS11001: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC67475%27 HTTP/1.1" 200 None
2026-03-28 05:39:38 [auto1.de] INFO: Scrape type for SC67475: 0
2026-03-28 05:39:38 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-28 05:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:39 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ18730%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for JJ18730: 0
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 05:39:39 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Scrape type for NB45839: 2
2026-03-28 05:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-28 05:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f58a000-6cc8-56a9-81f7-db2939dfb81c with scrape type 2
2026-03-28 05:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f58a000-6cc8-56a9-81f7-db2939dfb81c with scrape type 2
2026-03-28 05:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f58a000-6cc8-56a9-81f7-db2939dfb81c, identifier: NB45839
2026-03-28 05:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-28 05:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-28 05:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839 to the API
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:00:14Z',
 'fuel_type': 'diesel',
 'id': '7f58a000-6cc8-56a9-81f7-db2939dfb81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB45839',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 281153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2018}
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-28 05:39:39 [auto1.de] INFO: Saving data for NB45839: {'auction_closing_time': 1774713614.0, 'created_time': 1774552877.911765, 'last_price_update_time': 1774676379.944627}
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB45839') HTTP/1.1" 204 0
2026-03-28 05:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR25618%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for LR25618: 2
2026-03-28 05:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a92df0f-3ec0-5978-a5fc-be637a317c90 with identifier: LR25618
2026-03-28 05:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a92df0f-3ec0-5978-a5fc-be637a317c90 with scrape type 2
2026-03-28 05:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a92df0f-3ec0-5978-a5fc-be637a317c90 with scrape type 2
2026-03-28 05:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a92df0f-3ec0-5978-a5fc-be637a317c90, identifier: LR25618
2026-03-28 05:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a92df0f-3ec0-5978-a5fc-be637a317c90 with identifier: LR25618
2026-03-28 05:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a92df0f-3ec0-5978-a5fc-be637a317c90 with identifier: LR25618
2026-03-28 05:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a92df0f-3ec0-5978-a5fc-be637a317c90 with identifier: LR25618 to the API
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:04:59Z',
 'fuel_type': 'petrol',
 'id': '9a92df0f-3ec0-5978-a5fc-be637a317c90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR25618',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 67167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-24',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2013}
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR25618%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Saving data for LR25618: {'auction_closing_time': 1774713899.0, 'created_time': 1774467710.826696, 'last_price_update_time': 1774676380.49101}
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR25618') HTTP/1.1" 204 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ74394%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for VZ74394: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE03799%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for NE03799: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX61126%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for VX61126: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA58021%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for LA58021: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW28639%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for FW28639: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL18680%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for PL18680: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for VJ37696: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for JJ90967: 0
2026-03-28 05:39:40 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-28 05:39:40 [auto1.de] INFO: Scrape type for MR37276: 2
2026-03-28 05:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-28 05:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f626eca-b5cc-51c7-9b10-eda04952bce9 with scrape type 2
2026-03-28 05:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f626eca-b5cc-51c7-9b10-eda04952bce9 with scrape type 2
2026-03-28 05:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f626eca-b5cc-51c7-9b10-eda04952bce9, identifier: MR37276
2026-03-28 05:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-28 05:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-28 05:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276 to the API
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'petrol',
 'id': '0f626eca-b5cc-51c7-9b10-eda04952bce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR37276',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 140373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 3.2 V6 FSI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2008}
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Saving data for MR37276: {'auction_closing_time': 1774716967.0, 'created_time': 1774552211.225791, 'last_price_update_time': 1774676381.071666}
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR37276') HTTP/1.1" 204 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35425%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for ZX35425: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX70527%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for PX70527: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC99684%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for XC99684: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for VH61695: 2
2026-03-28 05:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-28 05:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with scrape type 2
2026-03-28 05:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with scrape type 2
2026-03-28 05:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8, identifier: VH61695
2026-03-28 05:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-28 05:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-28 05:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695 to the API
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:51:24Z',
 'fuel_type': 'gas',
 'id': '57e99e5a-9ef8-50c2-9cc3-3160297b4fa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 221524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 BIFuel Roncalli',
 'transmission': 'manual',
 'trim': 'Roncalli',
 'year': 2012}
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Saving data for VH61695: {'auction_closing_time': 1774716684.0, 'created_time': 1773917436.671797, 'last_price_update_time': 1774676381.691484}
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH61695') HTTP/1.1" 204 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23375%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for NT23375: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV48521%27 HTTP/1.1" 200 None
2026-03-28 05:39:41 [auto1.de] INFO: Scrape type for AV48521: 0
2026-03-28 05:39:41 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 05:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:42 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: RP45583
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP45583%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for RP45583: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC17090%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for VC17090: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG95526%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for VG95526: 0
2026-03-28 05:39:42 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-28 05:39:42 [auto1.de] INFO: Scrape type for MP89368: 2
2026-03-28 05:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-28 05:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9928227b-849f-5218-9fd2-fe114578665d with scrape type 2
2026-03-28 05:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9928227b-849f-5218-9fd2-fe114578665d with scrape type 2
2026-03-28 05:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9928227b-849f-5218-9fd2-fe114578665d, identifier: MP89368
2026-03-28 05:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-28 05:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-28 05:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368 to the API
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:24:15Z',
 'fuel_type': 'diesel',
 'id': '9928227b-849f-5218-9fd2-fe114578665d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP89368',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 200302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Saving data for MP89368: {'auction_closing_time': 1774715055.0, 'created_time': 1774550966.131932, 'last_price_update_time': 1774676383.10491}
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP89368') HTTP/1.1" 204 0
2026-03-28 05:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for GG51597: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN83221%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for FN83221: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL15351%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for CL15351: 2
2026-03-28 05:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with identifier: CL15351
2026-03-28 05:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with scrape type 2
2026-03-28 05:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with scrape type 2
2026-03-28 05:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74e6c9e5-02f9-5839-85fa-f48d43a059e6, identifier: CL15351
2026-03-28 05:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with identifier: CL15351
2026-03-28 05:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with identifier: CL15351
2026-03-28 05:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74e6c9e5-02f9-5839-85fa-f48d43a059e6 with identifier: CL15351 to the API
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:15Z',
 'fuel_type': 'petrol',
 'id': '74e6c9e5-02f9-5839-85fa-f48d43a059e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL15351',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 58253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-12',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL15351%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Saving data for CL15351: {'auction_closing_time': 1774716555.0, 'created_time': 1773131845.373307, 'last_price_update_time': 1774676383.648652}
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL15351') HTTP/1.1" 204 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD13282%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for FD13282: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for KX24751: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ40374%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for TJ40374: 0
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 05:39:43 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ59034%27 HTTP/1.1" 200 None
2026-03-28 05:39:43 [auto1.de] INFO: Scrape type for BJ59034: 2
2026-03-28 05:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with identifier: BJ59034
2026-03-28 05:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with scrape type 2
2026-03-28 05:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with scrape type 2
2026-03-28 05:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e6b8444-8d18-51f2-8d5a-7b808f1362e2, identifier: BJ59034
2026-03-28 05:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with identifier: BJ59034
2026-03-28 05:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with identifier: BJ59034
2026-03-28 05:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e6b8444-8d18-51f2-8d5a-7b808f1362e2 with identifier: BJ59034 to the API
2026-03-28 05:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 181,
 'expiration_date': '2026-03-28T16:21:38Z',
 'fuel_type': 'petrol',
 'id': '1e6b8444-8d18-51f2-8d5a-7b808f1362e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ59034',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 98595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-10',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2019}
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ59034%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Saving data for BJ59034: {'auction_closing_time': 1774714898.0, 'created_time': 1773861620.695414, 'last_price_update_time': 1774676384.194312}
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ59034') HTTP/1.1" 204 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00540%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for YC00540: 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for XT50939: 2
2026-03-28 05:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-28 05:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9375a0-3816-530a-a38f-0239cbec1197 with scrape type 2
2026-03-28 05:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da9375a0-3816-530a-a38f-0239cbec1197 with scrape type 2
2026-03-28 05:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da9375a0-3816-530a-a38f-0239cbec1197, identifier: XT50939
2026-03-28 05:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-28 05:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-28 05:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939 to the API
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:45:17Z',
 'fuel_type': 'petrol',
 'id': 'da9375a0-3816-530a-a38f-0239cbec1197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT50939',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 61113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Saving data for XT50939: {'auction_closing_time': 1774716317.0, 'created_time': 1774464036.90567, 'last_price_update_time': 1774676384.753551}
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT50939') HTTP/1.1" 204 0
2026-03-28 05:39:44 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-28 05:39:44 [auto1.de] INFO: Scrape type for DF24349: 2
2026-03-28 05:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-28 05:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72c9e52d-5849-5efe-a4a6-429836bffed6 with scrape type 2
2026-03-28 05:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72c9e52d-5849-5efe-a4a6-429836bffed6 with scrape type 2
2026-03-28 05:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72c9e52d-5849-5efe-a4a6-429836bffed6, identifier: DF24349
2026-03-28 05:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-28 05:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349
2026-03-28 05:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72c9e52d-5849-5efe-a4a6-429836bffed6 with identifier: DF24349 to the API
2026-03-28 05:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:56:51Z',
 'fuel_type': 'petrol',
 'id': '72c9e52d-5849-5efe-a4a6-429836bffed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF24349',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 163155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 500 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Saving data for DF24349: {'auction_closing_time': 1774717011.0, 'created_time': 1774463915.208196, 'last_price_update_time': 1774676385.193694}
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF24349') HTTP/1.1" 204 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG64089%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for RG64089: 2
2026-03-28 05:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with identifier: RG64089
2026-03-28 05:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with scrape type 2
2026-03-28 05:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with scrape type 2
2026-03-28 05:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a8b3684-6db0-5e49-b1fd-de591d2ea53f, identifier: RG64089
2026-03-28 05:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with identifier: RG64089
2026-03-28 05:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with identifier: RG64089
2026-03-28 05:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a8b3684-6db0-5e49-b1fd-de591d2ea53f with identifier: RG64089 to the API
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:06:49Z',
 'fuel_type': 'diesel',
 'id': '8a8b3684-6db0-5e49-b1fd-de591d2ea53f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG64089',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 138225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG64089%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Saving data for RG64089: {'auction_closing_time': 1774714009.0, 'created_time': 1774466240.207206, 'last_price_update_time': 1774676385.630981}
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG64089') HTTP/1.1" 204 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02191%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for AF02191: 0
2026-03-28 05:39:45 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-28 05:39:45 [auto1.de] INFO: Scrape type for CN06101: 2
2026-03-28 05:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-28 05:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with scrape type 2
2026-03-28 05:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with scrape type 2
2026-03-28 05:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703, identifier: CN06101
2026-03-28 05:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-28 05:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-28 05:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101 to the API
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:30:32Z',
 'fuel_type': 'diesel',
 'id': '23880b12-cb0a-5eb7-a05a-fd00bb3fd703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN06101',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 98342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2015}
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Saving data for CN06101: {'auction_closing_time': 1774715432.0, 'created_time': 1774552929.887914, 'last_price_update_time': 1774676386.126132}
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN06101') HTTP/1.1" 204 0
2026-03-28 05:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:46 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for ZD23730: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for LD10656: 0
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for SM09271: 2
2026-03-28 05:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-28 05:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b905d5-ed14-5215-8815-392c2acd6abf with scrape type 2
2026-03-28 05:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b905d5-ed14-5215-8815-392c2acd6abf with scrape type 2
2026-03-28 05:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b905d5-ed14-5215-8815-392c2acd6abf, identifier: SM09271
2026-03-28 05:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-28 05:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-28 05:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271 to the API
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:20Z',
 'fuel_type': 'petrol',
 'id': '94b905d5-ed14-5215-8815-392c2acd6abf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09271',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 77068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-11-03',
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Saving data for SM09271: {'auction_closing_time': 1774716380.0, 'created_time': 1774552915.551267, 'last_price_update_time': 1774676386.703393}
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM09271') HTTP/1.1" 204 0
2026-03-28 05:39:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:46 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX38122%27 HTTP/1.1" 200 None
2026-03-28 05:39:46 [auto1.de] INFO: Scrape type for RX38122: 2
2026-03-28 05:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb635e14-5b3e-5d18-986e-8e16643b2db0 with identifier: RX38122
2026-03-28 05:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb635e14-5b3e-5d18-986e-8e16643b2db0 with scrape type 2
2026-03-28 05:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb635e14-5b3e-5d18-986e-8e16643b2db0 with scrape type 2
2026-03-28 05:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb635e14-5b3e-5d18-986e-8e16643b2db0, identifier: RX38122
2026-03-28 05:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb635e14-5b3e-5d18-986e-8e16643b2db0 with identifier: RX38122
2026-03-28 05:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb635e14-5b3e-5d18-986e-8e16643b2db0 with identifier: RX38122
2026-03-28 05:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb635e14-5b3e-5d18-986e-8e16643b2db0 with identifier: RX38122 to the API
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:59:24Z',
 'fuel_type': 'petrol',
 'id': 'bb635e14-5b3e-5d18-986e-8e16643b2db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX38122',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 144351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-06',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX38122%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Saving data for RX38122: {'auction_closing_time': 1774717164.0, 'created_time': 1774466233.501613, 'last_price_update_time': 1774676387.295232}
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX38122') HTTP/1.1" 204 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS04579%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for MS04579: 2
2026-03-28 05:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b59cb7-6d54-5f72-afe5-4edf56474e1c with identifier: MS04579
2026-03-28 05:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b59cb7-6d54-5f72-afe5-4edf56474e1c with scrape type 2
2026-03-28 05:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b59cb7-6d54-5f72-afe5-4edf56474e1c with scrape type 2
2026-03-28 05:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53b59cb7-6d54-5f72-afe5-4edf56474e1c, identifier: MS04579
2026-03-28 05:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53b59cb7-6d54-5f72-afe5-4edf56474e1c with identifier: MS04579
2026-03-28 05:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53b59cb7-6d54-5f72-afe5-4edf56474e1c with identifier: MS04579
2026-03-28 05:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53b59cb7-6d54-5f72-afe5-4edf56474e1c with identifier: MS04579 to the API
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:18:32Z',
 'fuel_type': 'petrol',
 'id': '53b59cb7-6d54-5f72-afe5-4edf56474e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS04579',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 221567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-10',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Finesse',
 'transmission': 'manual',
 'trim': 'Finesse',
 'year': 2003}
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS04579%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Saving data for MS04579: {'auction_closing_time': 1774714712.0, 'created_time': 1774467223.144974, 'last_price_update_time': 1774676387.75077}
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS04579') HTTP/1.1" 204 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX93926%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for JX93926: 0
2026-03-28 05:39:47 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-28 05:39:47 [auto1.de] INFO: Scrape type for MR02811: 2
2026-03-28 05:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-28 05:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cecc06b9-2411-5cb3-b00d-1dbd985baa4b with scrape type 2
2026-03-28 05:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cecc06b9-2411-5cb3-b00d-1dbd985baa4b with scrape type 2
2026-03-28 05:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cecc06b9-2411-5cb3-b00d-1dbd985baa4b, identifier: MR02811
2026-03-28 05:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-28 05:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-28 05:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811 to the API
2026-03-28 05:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-28T16:16:46Z',
 'fuel_type': 'petrol',
 'id': 'cecc06b9-2411-5cb3-b00d-1dbd985baa4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR02811',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Camaro',
 'odometer': 63552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-09',
 'seller_name': None,
 'title': 'Chevrolet Camaro 3.8 V6 Cabrio',
 'transmission': 'automatic',
 'trim': 'Cabrio',
 'year': 2000}
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Saving data for MR02811: {'auction_closing_time': 1774714606.0, 'created_time': 1774552461.454304, 'last_price_update_time': 1774676388.218226}
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR02811') HTTP/1.1" 204 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for TE18178: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for JL42140: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62611%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for HY62611: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF87973%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for MF87973: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for BB37977: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE27507%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for AE27507: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX73377%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for RX73377: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07911%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for RW07911: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for FM78984: 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: AF68122
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for UB61823: 2
2026-03-28 05:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-28 05:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e153ff5-77aa-594b-936e-197a86210358 with scrape type 2
2026-03-28 05:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e153ff5-77aa-594b-936e-197a86210358 with scrape type 2
2026-03-28 05:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e153ff5-77aa-594b-936e-197a86210358, identifier: UB61823
2026-03-28 05:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-28 05:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-28 05:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823 to the API
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:12:06Z',
 'fuel_type': 'petrol',
 'id': '1e153ff5-77aa-594b-936e-197a86210358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB61823',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 18995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 MYSTYLE',
 'transmission': 'manual',
 'trim': 'MYSTYLE',
 'year': 2016}
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Saving data for UB61823: {'auction_closing_time': 1774714326.0, 'created_time': 1774552971.960014, 'last_price_update_time': 1774676388.817864}
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB61823') HTTP/1.1" 204 0
2026-03-28 05:39:48 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-28 05:39:48 [auto1.de] INFO: Scrape type for CN74001: 2
2026-03-28 05:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-28 05:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with scrape type 2
2026-03-28 05:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with scrape type 2
2026-03-28 05:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf, identifier: CN74001
2026-03-28 05:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-28 05:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-28 05:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001 to the API
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:03Z',
 'fuel_type': 'petrol',
 'id': '81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN74001',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 187120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-28 05:39:49 [auto1.de] INFO: Saving data for CN74001: {'auction_closing_time': 1774714503.0, 'created_time': 1774552852.778087, 'last_price_update_time': 1774676389.405624}
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN74001') HTTP/1.1" 204 0
2026-03-28 05:39:49 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 05:39:49 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-28 05:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:50 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC80699%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for CC80699: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for PP91076: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for HM75653: 2
2026-03-28 05:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-28 05:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb42351-35d3-599d-bafc-9b069019dea3 with scrape type 2
2026-03-28 05:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb42351-35d3-599d-bafc-9b069019dea3 with scrape type 2
2026-03-28 05:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfb42351-35d3-599d-bafc-9b069019dea3, identifier: HM75653
2026-03-28 05:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-28 05:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-28 05:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653 to the API
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:48Z',
 'fuel_type': 'diesel',
 'id': 'cfb42351-35d3-599d-bafc-9b069019dea3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM75653',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 194371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Saving data for HM75653: {'auction_closing_time': 1774716828.0, 'created_time': 1774553240.810425, 'last_price_update_time': 1774676390.830399}
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM75653') HTTP/1.1" 204 0
2026-03-28 05:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS71066%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for CS71066: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW04854%27 HTTP/1.1" 200 None
2026-03-28 05:39:50 [auto1.de] INFO: Scrape type for SW04854: 0
2026-03-28 05:39:50 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-28 05:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH18539%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for RH18539: 2
2026-03-28 05:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with identifier: RH18539
2026-03-28 05:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with scrape type 2
2026-03-28 05:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with scrape type 2
2026-03-28 05:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8aa37abc-6573-5f32-ae5c-cf952e2efe42, identifier: RH18539
2026-03-28 05:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with identifier: RH18539
2026-03-28 05:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with identifier: RH18539
2026-03-28 05:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8aa37abc-6573-5f32-ae5c-cf952e2efe42 with identifier: RH18539 to the API
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:44:45Z',
 'fuel_type': 'petrol',
 'id': '8aa37abc-6573-5f32-ae5c-cf952e2efe42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH18539',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 173464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-21',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2006}
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH18539%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Saving data for RH18539: {'auction_closing_time': 1774716285.0, 'created_time': 1773303974.449695, 'last_price_update_time': 1774676391.441323}
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH18539') HTTP/1.1" 204 0
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC87160%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for DC87160: 0
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for WZ38880: 0
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55827%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for WD55827: 2
2026-03-28 05:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ebde621-886b-596b-b801-6c0b9c8aa708 with identifier: WD55827
2026-03-28 05:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ebde621-886b-596b-b801-6c0b9c8aa708 with scrape type 2
2026-03-28 05:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ebde621-886b-596b-b801-6c0b9c8aa708 with scrape type 2
2026-03-28 05:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ebde621-886b-596b-b801-6c0b9c8aa708, identifier: WD55827
2026-03-28 05:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ebde621-886b-596b-b801-6c0b9c8aa708 with identifier: WD55827
2026-03-28 05:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ebde621-886b-596b-b801-6c0b9c8aa708 with identifier: WD55827
2026-03-28 05:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ebde621-886b-596b-b801-6c0b9c8aa708 with identifier: WD55827 to the API
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'diesel',
 'id': '2ebde621-886b-596b-b801-6c0b9c8aa708',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD55827',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 190014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55827%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Saving data for WD55827: {'auction_closing_time': 1774716967.0, 'created_time': 1774467827.347493, 'last_price_update_time': 1774676391.902235}
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD55827') HTTP/1.1" 204 0
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX30912%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for EX30912: 0
2026-03-28 05:39:51 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP81414%27 HTTP/1.1" 200 None
2026-03-28 05:39:51 [auto1.de] INFO: Scrape type for MP81414: 2
2026-03-28 05:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with identifier: MP81414
2026-03-28 05:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with scrape type 2
2026-03-28 05:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with scrape type 2
2026-03-28 05:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3, identifier: MP81414
2026-03-28 05:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with identifier: MP81414
2026-03-28 05:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with identifier: MP81414
2026-03-28 05:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3 with identifier: MP81414 to the API
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:38:53Z',
 'fuel_type': 'petrol',
 'id': '8a4437c8-c8d1-5a1f-adb9-bf5262abd1b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP81414',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 183683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-29',
 'seller_name': None,
 'title': 'Suzuki Swift 1.5 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2007}
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP81414%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Saving data for MP81414: {'auction_closing_time': 1774715933.0, 'created_time': 1774467902.344065, 'last_price_update_time': 1774676392.376714}
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP81414') HTTP/1.1" 204 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for TN32839: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB33889%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for SB33889: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC03935%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for TC03935: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY89366%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for JY89366: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-28 05:39:52 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Scrape type for PD62787: 2
2026-03-28 05:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-28 05:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876bc048-4e36-56eb-8284-16af95ced447 with scrape type 2
2026-03-28 05:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876bc048-4e36-56eb-8284-16af95ced447 with scrape type 2
2026-03-28 05:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 876bc048-4e36-56eb-8284-16af95ced447, identifier: PD62787
2026-03-28 05:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-28 05:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-28 05:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787 to the API
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:22:26Z',
 'fuel_type': 'diesel',
 'id': '876bc048-4e36-56eb-8284-16af95ced447',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD62787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 252716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-28 05:39:52 [auto1.de] INFO: Saving data for PD62787: {'auction_closing_time': 1774714946.0, 'created_time': 1774552823.185377, 'last_price_update_time': 1774676392.996474}
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD62787') HTTP/1.1" 204 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP40343%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for WP40343: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM58881%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for FM58881: 0
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-28 05:39:53 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-28 05:39:53 [auto1.de] INFO: Scrape type for PH27110: 2
2026-03-28 05:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-28 05:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with scrape type 2
2026-03-28 05:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with scrape type 2
2026-03-28 05:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d, identifier: PH27110
2026-03-28 05:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-28 05:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-28 05:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110 to the API
2026-03-28 05:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:49:17Z',
 'fuel_type': 'diesel',
 'id': '2fc0e5d1-5469-54bd-a54f-04c84f2dba3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH27110',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 67245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi Intro Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Intro Edition 4WD',
 'year': 2017}
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Saving data for PH27110: {'auction_closing_time': 1774716557.0, 'created_time': 1774552916.608733, 'last_price_update_time': 1774676394.325788}
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH27110') HTTP/1.1" 204 0
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-28 05:39:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:54 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Scrape type for ML64265: 2
2026-03-28 05:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-28 05:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with scrape type 2
2026-03-28 05:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with scrape type 2
2026-03-28 05:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9, identifier: ML64265
2026-03-28 05:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-28 05:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-28 05:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265 to the API
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:53Z',
 'fuel_type': 'petrol',
 'id': 'b0b6f6c0-4157-54f8-a52c-e2f6e01484b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML64265',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 119982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-28 05:39:54 [auto1.de] INFO: Saving data for ML64265: {'auction_closing_time': 1774716353.0, 'created_time': 1774552709.145644, 'last_price_update_time': 1774676394.886962}
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML64265') HTTP/1.1" 204 0
2026-03-28 05:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:54 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64304%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for JS64304: 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for CL60178: 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP47263%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for BP47263: 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for HS50383: 2
2026-03-28 05:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-28 05:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3949c849-05d0-53b2-aa79-033d22e5f06a with scrape type 2
2026-03-28 05:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3949c849-05d0-53b2-aa79-033d22e5f06a with scrape type 2
2026-03-28 05:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3949c849-05d0-53b2-aa79-033d22e5f06a, identifier: HS50383
2026-03-28 05:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-28 05:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383
2026-03-28 05:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3949c849-05d0-53b2-aa79-033d22e5f06a with identifier: HS50383 to the API
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:12Z',
 'fuel_type': 'petrol',
 'id': '3949c849-05d0-53b2-aa79-033d22e5f06a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS50383',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 205278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2006}
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Saving data for HS50383: {'auction_closing_time': 1774716792.0, 'created_time': 1774467511.618931, 'last_price_update_time': 1774676395.507965}
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS50383') HTTP/1.1" 204 0
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-28 05:39:55 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-28 05:39:55 [auto1.de] INFO: Scrape type for XZ81913: 2
2026-03-28 05:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-28 05:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e26894-70a6-51f3-8577-97077a50e469 with scrape type 2
2026-03-28 05:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3e26894-70a6-51f3-8577-97077a50e469 with scrape type 2
2026-03-28 05:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3e26894-70a6-51f3-8577-97077a50e469, identifier: XZ81913
2026-03-28 05:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-28 05:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-28 05:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913 to the API
2026-03-28 05:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:52:11Z',
 'fuel_type': 'diesel',
 'id': 'd3e26894-70a6-51f3-8577-97077a50e469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ81913',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 216191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Saving data for XZ81913: {'auction_closing_time': 1774716731.0, 'created_time': 1774550716.329423, 'last_price_update_time': 1774676396.125966}
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ81913') HTTP/1.1" 204 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL26328%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for GL26328: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for AF99280: 2
2026-03-28 05:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-28 05:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5877953-b16b-56e5-8252-3f10bfb6766e with scrape type 2
2026-03-28 05:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5877953-b16b-56e5-8252-3f10bfb6766e with scrape type 2
2026-03-28 05:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5877953-b16b-56e5-8252-3f10bfb6766e, identifier: AF99280
2026-03-28 05:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-28 05:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-28 05:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280 to the API
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:10:10Z',
 'fuel_type': 'hybrid',
 'id': 'c5877953-b16b-56e5-8252-3f10bfb6766e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF99280',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 68239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Saving data for AF99280: {'auction_closing_time': 1774714210.0, 'created_time': 1774553045.436158, 'last_price_update_time': 1774676396.574607}
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF99280') HTTP/1.1" 204 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for HZ75916: 0
2026-03-28 05:39:56 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-28 05:39:56 [auto1.de] INFO: Scrape type for HE65946: 2
2026-03-28 05:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-28 05:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f410918-6c2e-594f-b797-75a9c708b19b with scrape type 2
2026-03-28 05:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f410918-6c2e-594f-b797-75a9c708b19b with scrape type 2
2026-03-28 05:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f410918-6c2e-594f-b797-75a9c708b19b, identifier: HE65946
2026-03-28 05:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-28 05:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-28 05:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946 to the API
2026-03-28 05:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:11:23Z',
 'fuel_type': 'petrol',
 'id': '4f410918-6c2e-594f-b797-75a9c708b19b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE65946',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 159373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-26',
 'seller_name': None,
 'title': 'Toyota Auris 1.6 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2008}
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Saving data for HE65946: {'auction_closing_time': 1774714283.0, 'created_time': 1774589757.281489, 'last_price_update_time': 1774676397.131266}
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE65946') HTTP/1.1" 204 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL46180%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for LL46180: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for NE31655: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF33829%27 HTTP/1.1" 200 None
2026-03-28 05:39:57 [auto1.de] INFO: Scrape type for FF33829: 0
2026-03-28 05:39:57 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-28 05:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:39:58 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9199 | hits on page: 40
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for VL46030: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW00393%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for TW00393: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK38735%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for BK38735: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for AV40802: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for EZ76409: 2
2026-03-28 05:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-28 05:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with scrape type 2
2026-03-28 05:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with scrape type 2
2026-03-28 05:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b, identifier: EZ76409
2026-03-28 05:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-28 05:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-28 05:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409 to the API
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-28T16:52:08Z',
 'fuel_type': 'petrol',
 'id': '21e488e8-2903-5799-a9e2-3fb29a2f7a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ76409',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 112843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 500 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Saving data for EZ76409: {'auction_closing_time': 1774716728.0, 'created_time': 1774552272.914799, 'last_price_update_time': 1774676398.513235}
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ76409') HTTP/1.1" 204 0
2026-03-28 05:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: MY07793
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM29526%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for JM29526: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ69122%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for VZ69122: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for UW12612: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU43821%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for MU43821: 0
2026-03-28 05:39:58 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-28 05:39:58 [auto1.de] INFO: Scrape type for RT09261: 2
2026-03-28 05:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-28 05:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c215080-5e99-5303-ad3a-558a6e537bb4 with scrape type 2
2026-03-28 05:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c215080-5e99-5303-ad3a-558a6e537bb4 with scrape type 2
2026-03-28 05:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c215080-5e99-5303-ad3a-558a6e537bb4, identifier: RT09261
2026-03-28 05:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-28 05:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-28 05:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261 to the API
2026-03-28 05:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': '2c215080-5e99-5303-ad3a-558a6e537bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT09261',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 141636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Saving data for RT09261: {'auction_closing_time': 1774714335.0, 'created_time': 1773917552.791703, 'last_price_update_time': 1774676399.191156}
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT09261') HTTP/1.1" 204 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF97500%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for YF97500: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL53088%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for JL53088: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for VT41344: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD87783%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for RD87783: 2
2026-03-28 05:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca653ce-25a5-5680-ad62-ebe3c169ebea with identifier: RD87783
2026-03-28 05:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca653ce-25a5-5680-ad62-ebe3c169ebea with scrape type 2
2026-03-28 05:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca653ce-25a5-5680-ad62-ebe3c169ebea with scrape type 2
2026-03-28 05:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca653ce-25a5-5680-ad62-ebe3c169ebea, identifier: RD87783
2026-03-28 05:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca653ce-25a5-5680-ad62-ebe3c169ebea with identifier: RD87783
2026-03-28 05:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca653ce-25a5-5680-ad62-ebe3c169ebea with identifier: RD87783
2026-03-28 05:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca653ce-25a5-5680-ad62-ebe3c169ebea with identifier: RD87783 to the API
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:22:00Z',
 'fuel_type': 'petrol',
 'id': '8ca653ce-25a5-5680-ad62-ebe3c169ebea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD87783',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 213469,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-29',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD87783%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Saving data for RD87783: {'auction_closing_time': 1774714920.0, 'created_time': 1774463905.877238, 'last_price_update_time': 1774676399.827216}
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD87783') HTTP/1.1" 204 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV34042%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for BV34042: 0
2026-03-28 05:39:59 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP11154%27 HTTP/1.1" 200 None
2026-03-28 05:39:59 [auto1.de] INFO: Scrape type for AP11154: 2
2026-03-28 05:39:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with identifier: AP11154
2026-03-28 05:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with scrape type 2
2026-03-28 05:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with scrape type 2
2026-03-28 05:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b29c6b0-7332-51c3-85d1-8b774017b0d2, identifier: AP11154
2026-03-28 05:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with identifier: AP11154
2026-03-28 05:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with identifier: AP11154
2026-03-28 05:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b29c6b0-7332-51c3-85d1-8b774017b0d2 with identifier: AP11154 to the API
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:42:19Z',
 'fuel_type': 'diesel',
 'id': '0b29c6b0-7332-51c3-85d1-8b774017b0d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP11154',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 209050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP11154%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Saving data for AP11154: {'auction_closing_time': 1774716139.0, 'created_time': 1774550649.831359, 'last_price_update_time': 1774676400.304015}
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP11154') HTTP/1.1" 204 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ93275%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for CZ93275: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT27523%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for MT27523: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX90608%27 HTTP/1.1" 200 None
2026-03-28 05:40:00 [auto1.de] INFO: Scrape type for PX90608: 0
2026-03-28 05:40:00 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 05:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:01 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN08070%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RN08070: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RV28657: 2
2026-03-28 05:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-28 05:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with scrape type 2
2026-03-28 05:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with scrape type 2
2026-03-28 05:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 949427c7-4c42-5bfa-9dac-42c9f5bccef9, identifier: RV28657
2026-03-28 05:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-28 05:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657
2026-03-28 05:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 949427c7-4c42-5bfa-9dac-42c9f5bccef9 with identifier: RV28657 to the API
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:43:30Z',
 'fuel_type': 'petrol',
 'id': '949427c7-4c42-5bfa-9dac-42c9f5bccef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV28657',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 142507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-12',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Saving data for RV28657: {'auction_closing_time': 1774716210.0, 'created_time': 1774464436.751305, 'last_price_update_time': 1774676401.845248}
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV28657') HTTP/1.1" 204 0
2026-03-28 05:40:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK34860%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for RK34860: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF47308%27 HTTP/1.1" 200 None
2026-03-28 05:40:01 [auto1.de] INFO: Scrape type for GF47308: 0
2026-03-28 05:40:01 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for UY63030: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for NP40069: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB31232%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for JB31232: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX65526%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for WX65526: 2
2026-03-28 05:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed94cff-6b13-5197-bb03-02f5446f38a0 with identifier: WX65526
2026-03-28 05:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed94cff-6b13-5197-bb03-02f5446f38a0 with scrape type 2
2026-03-28 05:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed94cff-6b13-5197-bb03-02f5446f38a0 with scrape type 2
2026-03-28 05:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ed94cff-6b13-5197-bb03-02f5446f38a0, identifier: WX65526
2026-03-28 05:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ed94cff-6b13-5197-bb03-02f5446f38a0 with identifier: WX65526
2026-03-28 05:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ed94cff-6b13-5197-bb03-02f5446f38a0 with identifier: WX65526
2026-03-28 05:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ed94cff-6b13-5197-bb03-02f5446f38a0 with identifier: WX65526 to the API
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:44:47Z',
 'fuel_type': 'petrol',
 'id': '1ed94cff-6b13-5197-bb03-02f5446f38a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX65526',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 62164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-13',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX65526%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Saving data for WX65526: {'auction_closing_time': 1774716287.0, 'created_time': 1773861463.380978, 'last_price_update_time': 1774676402.529875}
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX65526') HTTP/1.1" 204 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for FN23082: 0
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 05:40:02 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79353%27 HTTP/1.1" 200 None
2026-03-28 05:40:02 [auto1.de] INFO: Scrape type for BH79353: 2
2026-03-28 05:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccc94e85-5af3-5cc8-b7b5-075b12134793 with identifier: BH79353
2026-03-28 05:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccc94e85-5af3-5cc8-b7b5-075b12134793 with scrape type 2
2026-03-28 05:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccc94e85-5af3-5cc8-b7b5-075b12134793 with scrape type 2
2026-03-28 05:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccc94e85-5af3-5cc8-b7b5-075b12134793, identifier: BH79353
2026-03-28 05:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccc94e85-5af3-5cc8-b7b5-075b12134793 with identifier: BH79353
2026-03-28 05:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccc94e85-5af3-5cc8-b7b5-075b12134793 with identifier: BH79353
2026-03-28 05:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccc94e85-5af3-5cc8-b7b5-075b12134793 with identifier: BH79353 to the API
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:53Z',
 'fuel_type': 'petrol',
 'id': 'ccc94e85-5af3-5cc8-b7b5-075b12134793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH79353',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 115044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-07',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79353%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Saving data for BH79353: {'auction_closing_time': 1774714373.0, 'created_time': 1772544882.551858, 'last_price_update_time': 1774676403.046816}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH79353') HTTP/1.1" 204 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN46018%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for BN46018: 2
2026-03-28 05:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with identifier: BN46018
2026-03-28 05:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with scrape type 2
2026-03-28 05:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with scrape type 2
2026-03-28 05:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a895ad6a-f3d1-5b69-9ac8-0da90ba7e307, identifier: BN46018
2026-03-28 05:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with identifier: BN46018
2026-03-28 05:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with identifier: BN46018
2026-03-28 05:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a895ad6a-f3d1-5b69-9ac8-0da90ba7e307 with identifier: BN46018 to the API
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:07Z',
 'fuel_type': 'petrol',
 'id': 'a895ad6a-f3d1-5b69-9ac8-0da90ba7e307',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN46018',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 137498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Color Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Color Edition ecoFlex',
 'year': 2016}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN46018%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Saving data for BN46018: {'auction_closing_time': 1774714807.0, 'created_time': 1774552907.165544, 'last_price_update_time': 1774676403.544236}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN46018') HTTP/1.1" 204 0
2026-03-28 05:40:03 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Scrape type for NZ21452: 2
2026-03-28 05:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-28 05:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b316e05b-3aa6-5474-a166-c55b6f1e2b6c with scrape type 2
2026-03-28 05:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b316e05b-3aa6-5474-a166-c55b6f1e2b6c with scrape type 2
2026-03-28 05:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b316e05b-3aa6-5474-a166-c55b6f1e2b6c, identifier: NZ21452
2026-03-28 05:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-28 05:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-28 05:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452 to the API
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:25Z',
 'fuel_type': 'petrol',
 'id': 'b316e05b-3aa6-5474-a166-c55b6f1e2b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ21452',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 43617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-28 05:40:03 [auto1.de] INFO: Saving data for NZ21452: {'auction_closing_time': 1774713865.0, 'created_time': 1774552913.163639, 'last_price_update_time': 1774676403.993123}
2026-03-28 05:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ21452') HTTP/1.1" 204 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for EB21377: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-28 05:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:04 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95925%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for VP95925: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11431%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for EJ11431: 0
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-28 05:40:04 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV72401%27 HTTP/1.1" 200 None
2026-03-28 05:40:04 [auto1.de] INFO: Scrape type for HV72401: 2
2026-03-28 05:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df7f5f69-4b01-54a9-9729-5eedaa70086f with identifier: HV72401
2026-03-28 05:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7f5f69-4b01-54a9-9729-5eedaa70086f with scrape type 2
2026-03-28 05:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df7f5f69-4b01-54a9-9729-5eedaa70086f with scrape type 2
2026-03-28 05:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df7f5f69-4b01-54a9-9729-5eedaa70086f, identifier: HV72401
2026-03-28 05:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df7f5f69-4b01-54a9-9729-5eedaa70086f with identifier: HV72401
2026-03-28 05:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df7f5f69-4b01-54a9-9729-5eedaa70086f with identifier: HV72401
2026-03-28 05:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df7f5f69-4b01-54a9-9729-5eedaa70086f with identifier: HV72401 to the API
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:36:59Z',
 'fuel_type': 'petrol',
 'id': 'df7f5f69-4b01-54a9-9729-5eedaa70086f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV72401',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 225544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2011}
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV72401%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Saving data for HV72401: {'auction_closing_time': 1774715819.0, 'created_time': 1774553141.739867, 'last_price_update_time': 1774676405.243415}
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV72401') HTTP/1.1" 204 0
2026-03-28 05:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ15384%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for ZJ15384: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ51089%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for EJ51089: 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH43725%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for RH43725: 2
2026-03-28 05:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with identifier: RH43725
2026-03-28 05:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with scrape type 2
2026-03-28 05:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with scrape type 2
2026-03-28 05:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6dc25ae-8c03-51e1-bfe3-4dcab256c256, identifier: RH43725
2026-03-28 05:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with identifier: RH43725
2026-03-28 05:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with identifier: RH43725
2026-03-28 05:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6dc25ae-8c03-51e1-bfe3-4dcab256c256 with identifier: RH43725 to the API
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:28:05Z',
 'fuel_type': 'hybrid',
 'id': 'b6dc25ae-8c03-51e1-bfe3-4dcab256c256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH43725',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 83809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250e Shooting Brake Edition 2020 AMG '
          'Line',
 'transmission': 'automatic',
 'trim': 'Edition 2020 AMG Line',
 'year': 2021}
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH43725%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Saving data for RH43725: {'auction_closing_time': 1774715285.0, 'created_time': 1773306545.304856, 'last_price_update_time': 1774676405.844411}
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH43725') HTTP/1.1" 204 0
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-28 05:40:05 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK41211%27 HTTP/1.1" 200 None
2026-03-28 05:40:05 [auto1.de] INFO: Scrape type for TK41211: 2
2026-03-28 05:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9636fb8f-1158-5c18-8a78-d1012da51c81 with identifier: TK41211
2026-03-28 05:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9636fb8f-1158-5c18-8a78-d1012da51c81 with scrape type 2
2026-03-28 05:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9636fb8f-1158-5c18-8a78-d1012da51c81 with scrape type 2
2026-03-28 05:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9636fb8f-1158-5c18-8a78-d1012da51c81, identifier: TK41211
2026-03-28 05:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9636fb8f-1158-5c18-8a78-d1012da51c81 with identifier: TK41211
2026-03-28 05:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9636fb8f-1158-5c18-8a78-d1012da51c81 with identifier: TK41211
2026-03-28 05:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9636fb8f-1158-5c18-8a78-d1012da51c81 with identifier: TK41211 to the API
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:11:14Z',
 'fuel_type': 'petrol',
 'id': '9636fb8f-1158-5c18-8a78-d1012da51c81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK41211',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 177110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK41211%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Saving data for TK41211: {'auction_closing_time': 1774714274.0, 'created_time': 1773308359.615502, 'last_price_update_time': 1774676406.421536}
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK41211') HTTP/1.1" 204 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for ZY94421: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94118%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for EH94118: 0
2026-03-28 05:40:06 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV02416%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Scrape type for PV02416: 2
2026-03-28 05:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a77c2957-c968-5681-b4a4-3c429297c1a8 with identifier: PV02416
2026-03-28 05:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a77c2957-c968-5681-b4a4-3c429297c1a8 with scrape type 2
2026-03-28 05:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a77c2957-c968-5681-b4a4-3c429297c1a8 with scrape type 2
2026-03-28 05:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a77c2957-c968-5681-b4a4-3c429297c1a8, identifier: PV02416
2026-03-28 05:40:06 [scrapy.extensions.logstats] INFO: Crawled 103 pages (at 15 pages/min), scraped 332 items (at 82 items/min)
2026-03-28 05:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a77c2957-c968-5681-b4a4-3c429297c1a8 with identifier: PV02416
2026-03-28 05:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a77c2957-c968-5681-b4a4-3c429297c1a8 with identifier: PV02416
2026-03-28 05:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a77c2957-c968-5681-b4a4-3c429297c1a8 with identifier: PV02416 to the API
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:56Z',
 'fuel_type': 'petrol',
 'id': 'a77c2957-c968-5681-b4a4-3c429297c1a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV02416',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 35098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-25',
 'seller_name': None,
 'title': 'Fiat Panda 1.0 Mild-Hybrid City Cross',
 'transmission': 'manual',
 'trim': 'City Cross',
 'year': 2021}
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV02416%27 HTTP/1.1" 200 None
2026-03-28 05:40:06 [auto1.de] INFO: Saving data for PV02416: {'auction_closing_time': 1774715216.0, 'created_time': 1774552974.103157, 'last_price_update_time': 1774676406.89906}
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV02416') HTTP/1.1" 204 0
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS74297%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for MS74297: 0
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for AR72060: 0
2026-03-28 05:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:07 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-28 05:40:07 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM05661%27 HTTP/1.1" 200 None
2026-03-28 05:40:07 [auto1.de] INFO: Scrape type for YM05661: 2
2026-03-28 05:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 150345d2-ef6b-51cf-bde5-d2411567d3b1 with identifier: YM05661
2026-03-28 05:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 150345d2-ef6b-51cf-bde5-d2411567d3b1 with scrape type 2
2026-03-28 05:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 150345d2-ef6b-51cf-bde5-d2411567d3b1 with scrape type 2
2026-03-28 05:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 150345d2-ef6b-51cf-bde5-d2411567d3b1, identifier: YM05661
2026-03-28 05:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 150345d2-ef6b-51cf-bde5-d2411567d3b1 with identifier: YM05661
2026-03-28 05:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 150345d2-ef6b-51cf-bde5-d2411567d3b1 with identifier: YM05661
2026-03-28 05:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 150345d2-ef6b-51cf-bde5-d2411567d3b1 with identifier: YM05661 to the API
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-28T16:53:34Z',
 'fuel_type': 'petrol',
 'id': '150345d2-ef6b-51cf-bde5-d2411567d3b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM05661',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 90848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-01',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM05661%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Saving data for YM05661: {'auction_closing_time': 1774716814.0, 'created_time': 1774463868.079971, 'last_price_update_time': 1774676408.397897}
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM05661') HTTP/1.1" 204 0
2026-03-28 05:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE60710%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for XE60710: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: NC17523
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC17523%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for NC17523: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY88235%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for UY88235: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 05:40:08 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Scrape type for NF12247: 2
2026-03-28 05:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-28 05:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with scrape type 2
2026-03-28 05:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with scrape type 2
2026-03-28 05:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85, identifier: NF12247
2026-03-28 05:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-28 05:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-28 05:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247 to the API
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:33:06Z',
 'fuel_type': 'diesel',
 'id': 'a9e4dd7c-ac41-5b0a-b33d-1f48982beb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF12247',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 193711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-28 05:40:08 [auto1.de] INFO: Saving data for NF12247: {'auction_closing_time': 1774715586.0, 'created_time': 1774552916.097325, 'last_price_update_time': 1774676408.904176}
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF12247') HTTP/1.1" 204 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN47371%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for AN47371: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL64193%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for KL64193: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for SY11611: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for RK19274: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for SC06159: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP74638%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for FP74638: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48738%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for HY48738: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26579%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for CR26579: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-28 05:40:09 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS70377%27 HTTP/1.1" 200 None
2026-03-28 05:40:09 [auto1.de] INFO: Scrape type for HS70377: 0
2026-03-28 05:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:10 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP80711%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for VP80711: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Scrape type for VH72223: 2
2026-03-28 05:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-28 05:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12119fa-ef49-55dd-ad8b-1186088945a1 with scrape type 2
2026-03-28 05:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12119fa-ef49-55dd-ad8b-1186088945a1 with scrape type 2
2026-03-28 05:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d12119fa-ef49-55dd-ad8b-1186088945a1, identifier: VH72223
2026-03-28 05:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-28 05:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-28 05:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223 to the API
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:04:29Z',
 'fuel_type': 'diesel',
 'id': 'd12119fa-ef49-55dd-ad8b-1186088945a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH72223',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 110292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-07',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Sport 4x4',
 'transmission': 'automatic',
 'trim': 'Sport 4x4',
 'year': 2016}
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-28 05:40:10 [auto1.de] INFO: Saving data for VH72223: {'auction_closing_time': 1774713869.0, 'created_time': 1774463916.96149, 'last_price_update_time': 1774676410.794346}
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH72223') HTTP/1.1" 204 0
2026-03-28 05:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-28 05:40:10 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB69673%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for AB69673: 2
2026-03-28 05:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047ff3ba-8d4a-5d48-8535-aa3064401d30 with identifier: AB69673
2026-03-28 05:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047ff3ba-8d4a-5d48-8535-aa3064401d30 with scrape type 2
2026-03-28 05:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047ff3ba-8d4a-5d48-8535-aa3064401d30 with scrape type 2
2026-03-28 05:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 047ff3ba-8d4a-5d48-8535-aa3064401d30, identifier: AB69673
2026-03-28 05:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 047ff3ba-8d4a-5d48-8535-aa3064401d30 with identifier: AB69673
2026-03-28 05:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 047ff3ba-8d4a-5d48-8535-aa3064401d30 with identifier: AB69673
2026-03-28 05:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 047ff3ba-8d4a-5d48-8535-aa3064401d30 with identifier: AB69673 to the API
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '047ff3ba-8d4a-5d48-8535-aa3064401d30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB69673',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 234063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-26',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB69673%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Saving data for AB69673: {'auction_closing_time': 1774716173.0, 'created_time': 1774551148.970163, 'last_price_update_time': 1774676411.424724}
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB69673') HTTP/1.1" 204 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV51703%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for YV51703: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69542%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for BT69542: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for XS43563: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for PG58570: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS42443%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for DS42443: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15170%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for SD15170: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-28 05:40:11 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE10245%27 HTTP/1.1" 200 None
2026-03-28 05:40:11 [auto1.de] INFO: Scrape type for GE10245: 2
2026-03-28 05:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ffe787a-c332-540d-9034-cc914868c73e with identifier: GE10245
2026-03-28 05:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ffe787a-c332-540d-9034-cc914868c73e with scrape type 2
2026-03-28 05:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ffe787a-c332-540d-9034-cc914868c73e with scrape type 2
2026-03-28 05:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ffe787a-c332-540d-9034-cc914868c73e, identifier: GE10245
2026-03-28 05:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ffe787a-c332-540d-9034-cc914868c73e with identifier: GE10245
2026-03-28 05:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ffe787a-c332-540d-9034-cc914868c73e with identifier: GE10245
2026-03-28 05:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ffe787a-c332-540d-9034-cc914868c73e with identifier: GE10245 to the API
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:47:52Z',
 'fuel_type': 'petrol',
 'id': '8ffe787a-c332-540d-9034-cc914868c73e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE10245',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 121004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE10245%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Saving data for GE10245: {'auction_closing_time': 1774716472.0, 'created_time': 1774464466.452991, 'last_price_update_time': 1774676412.047111}
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE10245') HTTP/1.1" 204 0
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW24553%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Scrape type for PW24553: 0
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL31198%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Scrape type for TL31198: 0
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Scrape type for ST88871: 2
2026-03-28 05:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-28 05:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with scrape type 2
2026-03-28 05:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with scrape type 2
2026-03-28 05:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28, identifier: ST88871
2026-03-28 05:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-28 05:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-28 05:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871 to the API
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:59:27Z',
 'fuel_type': 'petrol',
 'id': '6504cb85-5ea6-5219-89c1-5cd1c4bfac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST88871',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 187004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2012}
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Saving data for ST88871: {'auction_closing_time': 1774717167.0, 'created_time': 1774551118.560065, 'last_price_update_time': 1774676412.60973}
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST88871') HTTP/1.1" 204 0
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW30333%27 HTTP/1.1" 200 None
2026-03-28 05:40:12 [auto1.de] INFO: Scrape type for SW30333: 0
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 05:40:12 [auto1.de] INFO: Found listing with ID: WP44552
2026-03-28 05:40:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:13 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 05:40:13 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL05450%27 HTTP/1.1" 200 None
2026-03-28 05:40:13 [auto1.de] INFO: Scrape type for WL05450: 2
2026-03-28 05:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d1a08b-9c7a-50c7-8231-99589a8c5715 with identifier: WL05450
2026-03-28 05:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d1a08b-9c7a-50c7-8231-99589a8c5715 with scrape type 2
2026-03-28 05:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d1a08b-9c7a-50c7-8231-99589a8c5715 with scrape type 2
2026-03-28 05:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50d1a08b-9c7a-50c7-8231-99589a8c5715, identifier: WL05450
2026-03-28 05:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50d1a08b-9c7a-50c7-8231-99589a8c5715 with identifier: WL05450
2026-03-28 05:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50d1a08b-9c7a-50c7-8231-99589a8c5715 with identifier: WL05450
2026-03-28 05:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50d1a08b-9c7a-50c7-8231-99589a8c5715 with identifier: WL05450 to the API
2026-03-28 05:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 288,
 'expiration_date': '2026-03-28T16:23:52Z',
 'fuel_type': 'diesel',
 'id': '50d1a08b-9c7a-50c7-8231-99589a8c5715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL05450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 35928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL05450%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Saving data for WL05450: {'auction_closing_time': 1774715032.0, 'created_time': 1773429356.572524, 'last_price_update_time': 1774676414.183127}
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL05450') HTTP/1.1" 204 0
2026-03-28 05:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU23200%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for VU23200: 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for KM26302: 2
2026-03-28 05:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-28 05:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52574c79-a952-5580-9764-5023950006b1 with scrape type 2
2026-03-28 05:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52574c79-a952-5580-9764-5023950006b1 with scrape type 2
2026-03-28 05:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52574c79-a952-5580-9764-5023950006b1, identifier: KM26302
2026-03-28 05:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-28 05:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-28 05:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302 to the API
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:16Z',
 'fuel_type': 'petrol',
 'id': '52574c79-a952-5580-9764-5023950006b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM26302',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 106692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Saving data for KM26302: {'auction_closing_time': 1774714576.0, 'created_time': 1774551628.213805, 'last_price_update_time': 1774676414.778489}
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM26302') HTTP/1.1" 204 0
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-28 05:40:14 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY57485%27 HTTP/1.1" 200 None
2026-03-28 05:40:14 [auto1.de] INFO: Scrape type for BY57485: 2
2026-03-28 05:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc5c7c97-ca9c-5221-9649-7da6f6c4955f with identifier: BY57485
2026-03-28 05:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc5c7c97-ca9c-5221-9649-7da6f6c4955f with scrape type 2
2026-03-28 05:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc5c7c97-ca9c-5221-9649-7da6f6c4955f with scrape type 2
2026-03-28 05:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc5c7c97-ca9c-5221-9649-7da6f6c4955f, identifier: BY57485
2026-03-28 05:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc5c7c97-ca9c-5221-9649-7da6f6c4955f with identifier: BY57485
2026-03-28 05:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc5c7c97-ca9c-5221-9649-7da6f6c4955f with identifier: BY57485
2026-03-28 05:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc5c7c97-ca9c-5221-9649-7da6f6c4955f with identifier: BY57485 to the API
2026-03-28 05:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:46:39Z',
 'fuel_type': 'diesel',
 'id': 'bc5c7c97-ca9c-5221-9649-7da6f6c4955f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY57485',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 148571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY57485%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Saving data for BY57485: {'auction_closing_time': 1774716399.0, 'created_time': 1774466420.299825, 'last_price_update_time': 1774676415.213732}
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY57485') HTTP/1.1" 204 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX50499%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for HX50499: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV04450%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for GV04450: 2
2026-03-28 05:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with identifier: GV04450
2026-03-28 05:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with scrape type 2
2026-03-28 05:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with scrape type 2
2026-03-28 05:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2102af5d-7c5e-53d5-b8e1-1adabd536b9a, identifier: GV04450
2026-03-28 05:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with identifier: GV04450
2026-03-28 05:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with identifier: GV04450
2026-03-28 05:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2102af5d-7c5e-53d5-b8e1-1adabd536b9a with identifier: GV04450 to the API
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:52:59Z',
 'fuel_type': 'petrol',
 'id': '2102af5d-7c5e-53d5-b8e1-1adabd536b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV04450',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 64968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-15',
 'seller_name': None,
 'title': 'Opel Grandland X 1.2 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2019}
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV04450%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Saving data for GV04450: {'auction_closing_time': 1774716779.0, 'created_time': 1774466611.994954, 'last_price_update_time': 1774676415.769463}
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV04450') HTTP/1.1" 204 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07497%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for NC07497: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for CC99000: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM61322%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for PM61322: 0
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 05:40:15 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-28 05:40:15 [auto1.de] INFO: Scrape type for GJ53227: 2
2026-03-28 05:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-28 05:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acff37a5-ade0-5097-aee9-5e18fe831074 with scrape type 2
2026-03-28 05:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acff37a5-ade0-5097-aee9-5e18fe831074 with scrape type 2
2026-03-28 05:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acff37a5-ade0-5097-aee9-5e18fe831074, identifier: GJ53227
2026-03-28 05:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-28 05:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-28 05:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227 to the API
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:02:41Z',
 'fuel_type': 'diesel',
 'id': 'acff37a5-ade0-5097-aee9-5e18fe831074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ53227',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 150872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-31',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Saving data for GJ53227: {'auction_closing_time': 1774713761.0, 'created_time': 1774553056.173358, 'last_price_update_time': 1774676416.269877}
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ53227') HTTP/1.1" 204 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU27618%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for FU27618: 2
2026-03-28 05:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with identifier: FU27618
2026-03-28 05:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with scrape type 2
2026-03-28 05:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with scrape type 2
2026-03-28 05:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee8a5a41-a245-5b2e-bcdc-89a59df54c03, identifier: FU27618
2026-03-28 05:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with identifier: FU27618
2026-03-28 05:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with identifier: FU27618
2026-03-28 05:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee8a5a41-a245-5b2e-bcdc-89a59df54c03 with identifier: FU27618 to the API
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:18:41Z',
 'fuel_type': 'diesel',
 'id': 'ee8a5a41-a245-5b2e-bcdc-89a59df54c03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU27618',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 193732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.6 TDI S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2012}
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU27618%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Saving data for FU27618: {'auction_closing_time': 1774714721.0, 'created_time': 1774551405.804447, 'last_price_update_time': 1774676416.778009}
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU27618') HTTP/1.1" 204 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18045%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for MS18045: 0
2026-03-28 05:40:16 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ21212%27 HTTP/1.1" 200 None
2026-03-28 05:40:16 [auto1.de] INFO: Scrape type for NJ21212: 2
2026-03-28 05:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-03-28 05:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with scrape type 2
2026-03-28 05:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with scrape type 2
2026-03-28 05:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c3e7dc-ee89-5b73-a140-a58ab841cce6, identifier: NJ21212
2026-03-28 05:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-03-28 05:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212
2026-03-28 05:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c3e7dc-ee89-5b73-a140-a58ab841cce6 with identifier: NJ21212 to the API
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:32:35Z',
 'fuel_type': 'diesel',
 'id': '41c3e7dc-ee89-5b73-a140-a58ab841cce6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ21212',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 164288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Mitsubishi ASX 2.2 DI-D Comfort Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Comfort Edition 4WD',
 'year': 2015}
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ21212%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Saving data for NJ21212: {'auction_closing_time': 1774715555.0, 'created_time': 1774468306.440967, 'last_price_update_time': 1774676417.233221}
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ21212') HTTP/1.1" 204 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59870%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for WA59870: 2
2026-03-28 05:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 046fb8b6-1d1d-5e84-b889-dfd7e019268d with identifier: WA59870
2026-03-28 05:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 046fb8b6-1d1d-5e84-b889-dfd7e019268d with scrape type 2
2026-03-28 05:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 046fb8b6-1d1d-5e84-b889-dfd7e019268d with scrape type 2
2026-03-28 05:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 046fb8b6-1d1d-5e84-b889-dfd7e019268d, identifier: WA59870
2026-03-28 05:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 046fb8b6-1d1d-5e84-b889-dfd7e019268d with identifier: WA59870
2026-03-28 05:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 046fb8b6-1d1d-5e84-b889-dfd7e019268d with identifier: WA59870
2026-03-28 05:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 046fb8b6-1d1d-5e84-b889-dfd7e019268d with identifier: WA59870 to the API
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:07Z',
 'fuel_type': 'petrol',
 'id': '046fb8b6-1d1d-5e84-b889-dfd7e019268d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA59870',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 85053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2019}
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59870%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Saving data for WA59870: {'auction_closing_time': 1774714447.0, 'created_time': 1773305413.548646, 'last_price_update_time': 1774676417.67512}
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA59870') HTTP/1.1" 204 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL90349%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for YL90349: 0
2026-03-28 05:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:17 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28912%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for SG28912: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL74765%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for WL74765: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95645%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for RC95645: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for TG47191: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for MS18756: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ79433%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for XJ79433: 0
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-28 05:40:17 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-28 05:40:17 [auto1.de] INFO: Scrape type for BB52240: 2
2026-03-28 05:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-28 05:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35afb30-bcf9-53ad-b497-284f3b630062 with scrape type 2
2026-03-28 05:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a35afb30-bcf9-53ad-b497-284f3b630062 with scrape type 2
2026-03-28 05:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a35afb30-bcf9-53ad-b497-284f3b630062, identifier: BB52240
2026-03-28 05:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-28 05:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-28 05:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240 to the API
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:36Z',
 'fuel_type': 'diesel',
 'id': 'a35afb30-bcf9-53ad-b497-284f3b630062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB52240',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 181540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Saving data for BB52240: {'auction_closing_time': 1774714236.0, 'created_time': 1774550628.1235, 'last_price_update_time': 1774676418.353184}
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB52240') HTTP/1.1" 204 0
2026-03-28 05:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK01451%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for NK01451: 2
2026-03-28 05:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with identifier: NK01451
2026-03-28 05:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with scrape type 2
2026-03-28 05:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with scrape type 2
2026-03-28 05:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9, identifier: NK01451
2026-03-28 05:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with identifier: NK01451
2026-03-28 05:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with identifier: NK01451
2026-03-28 05:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9 with identifier: NK01451 to the API
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'diesel',
 'id': '44e9dd6c-ee23-54d8-a8b5-08a4064e2ba9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK01451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 130183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK01451%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Saving data for NK01451: {'auction_closing_time': 1774714961.0, 'created_time': 1774463870.43204, 'last_price_update_time': 1774676418.883706}
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK01451') HTTP/1.1" 204 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for HU72855: 0
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 05:40:18 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-28 05:40:18 [auto1.de] INFO: Scrape type for HT34266: 2
2026-03-28 05:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-28 05:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd67018-14e1-5590-b63c-dc03bfb4d13c with scrape type 2
2026-03-28 05:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccd67018-14e1-5590-b63c-dc03bfb4d13c with scrape type 2
2026-03-28 05:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccd67018-14e1-5590-b63c-dc03bfb4d13c, identifier: HT34266
2026-03-28 05:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-28 05:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-28 05:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266 to the API
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'diesel',
 'id': 'ccd67018-14e1-5590-b63c-dc03bfb4d13c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT34266',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 197270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Saving data for HT34266: {'auction_closing_time': 1774715015.0, 'created_time': 1774551128.02563, 'last_price_update_time': 1774676419.345116}
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT34266') HTTP/1.1" 204 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42490%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for ZS42490: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC11687%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for SC11687: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY56978%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for XY56978: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: GK61319
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK61319%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for GK61319: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM68743%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for JM68743: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-28 05:40:19 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD08284%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Scrape type for YD08284: 2
2026-03-28 05:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d53fa33-15fb-56a4-91b6-fc0e0601308b with identifier: YD08284
2026-03-28 05:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d53fa33-15fb-56a4-91b6-fc0e0601308b with scrape type 2
2026-03-28 05:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d53fa33-15fb-56a4-91b6-fc0e0601308b with scrape type 2
2026-03-28 05:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d53fa33-15fb-56a4-91b6-fc0e0601308b, identifier: YD08284
2026-03-28 05:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d53fa33-15fb-56a4-91b6-fc0e0601308b with identifier: YD08284
2026-03-28 05:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d53fa33-15fb-56a4-91b6-fc0e0601308b with identifier: YD08284
2026-03-28 05:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d53fa33-15fb-56a4-91b6-fc0e0601308b with identifier: YD08284 to the API
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:38:14Z',
 'fuel_type': 'diesel',
 'id': '7d53fa33-15fb-56a4-91b6-fc0e0601308b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD08284',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 262848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2009}
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD08284%27 HTTP/1.1" 200 None
2026-03-28 05:40:19 [auto1.de] INFO: Saving data for YD08284: {'auction_closing_time': 1774715894.0, 'created_time': 1774463878.635039, 'last_price_update_time': 1774676419.907038}
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD08284') HTTP/1.1" 204 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81218%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for TR81218: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40797%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for RS40797: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for MU50288: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for HJ77178: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for BH21613: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for JZ46683: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT07379%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for WT07379: 0
2026-03-28 05:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:20 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ43600%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for HZ43600: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for PX80115: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-28 05:40:20 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 05:40:20 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for UR98494: 2
2026-03-28 05:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-28 05:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38544af-9d7b-507e-931b-e0eebea7646f with scrape type 2
2026-03-28 05:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38544af-9d7b-507e-931b-e0eebea7646f with scrape type 2
2026-03-28 05:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38544af-9d7b-507e-931b-e0eebea7646f, identifier: UR98494
2026-03-28 05:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-28 05:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-28 05:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494 to the API
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'petrol',
 'id': 'f38544af-9d7b-507e-931b-e0eebea7646f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR98494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 257313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Saving data for UR98494: {'auction_closing_time': 1774716591.0, 'created_time': 1774553184.708836, 'last_price_update_time': 1774676421.469585}
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR98494') HTTP/1.1" 204 0
2026-03-28 05:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05460%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for YY05460: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-28 05:40:21 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ24918%27 HTTP/1.1" 200 None
2026-03-28 05:40:21 [auto1.de] INFO: Scrape type for CZ24918: 2
2026-03-28 05:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with identifier: CZ24918
2026-03-28 05:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with scrape type 2
2026-03-28 05:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with scrape type 2
2026-03-28 05:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b0bc4c2-1c34-5b28-aa1d-14125f61faac, identifier: CZ24918
2026-03-28 05:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with identifier: CZ24918
2026-03-28 05:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with identifier: CZ24918
2026-03-28 05:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b0bc4c2-1c34-5b28-aa1d-14125f61faac with identifier: CZ24918 to the API
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:11:22Z',
 'fuel_type': 'petrol',
 'id': '7b0bc4c2-1c34-5b28-aa1d-14125f61faac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ24918',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 118940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-07',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2018}
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ24918%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Saving data for CZ24918: {'auction_closing_time': 1774714282.0, 'created_time': 1774466565.48314, 'last_price_update_time': 1774676422.102211}
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ24918') HTTP/1.1" 204 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR22562%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for YR22562: 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF58476%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for YF58476: 2
2026-03-28 05:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a847503-0c02-5e79-bde1-dd1c580797c8 with identifier: YF58476
2026-03-28 05:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a847503-0c02-5e79-bde1-dd1c580797c8 with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a847503-0c02-5e79-bde1-dd1c580797c8 with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a847503-0c02-5e79-bde1-dd1c580797c8, identifier: YF58476
2026-03-28 05:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a847503-0c02-5e79-bde1-dd1c580797c8 with identifier: YF58476
2026-03-28 05:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a847503-0c02-5e79-bde1-dd1c580797c8 with identifier: YF58476
2026-03-28 05:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a847503-0c02-5e79-bde1-dd1c580797c8 with identifier: YF58476 to the API
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:19Z',
 'fuel_type': 'diesel',
 'id': '1a847503-0c02-5e79-bde1-dd1c580797c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF58476',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2017}
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF58476%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Saving data for YF58476: {'auction_closing_time': 1774713739.0, 'created_time': 1774552363.314684, 'last_price_update_time': 1774676422.538676}
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF58476') HTTP/1.1" 204 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for EL87499: 0
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 05:40:22 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG88444%27 HTTP/1.1" 200 None
2026-03-28 05:40:22 [auto1.de] INFO: Scrape type for ZG88444: 2
2026-03-28 05:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea23fa0-d77e-52f2-9409-50e7b6ca7524 with identifier: ZG88444
2026-03-28 05:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea23fa0-d77e-52f2-9409-50e7b6ca7524 with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bea23fa0-d77e-52f2-9409-50e7b6ca7524 with scrape type 2
2026-03-28 05:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea23fa0-d77e-52f2-9409-50e7b6ca7524, identifier: ZG88444
2026-03-28 05:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea23fa0-d77e-52f2-9409-50e7b6ca7524 with identifier: ZG88444
2026-03-28 05:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea23fa0-d77e-52f2-9409-50e7b6ca7524 with identifier: ZG88444
2026-03-28 05:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea23fa0-d77e-52f2-9409-50e7b6ca7524 with identifier: ZG88444 to the API
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'diesel',
 'id': 'bea23fa0-d77e-52f2-9409-50e7b6ca7524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG88444',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 165543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 119 CDI lang Select',
 'transmission': 'automatic',
 'trim': 'lang Select',
 'year': 2017}
2026-03-28 05:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG88444%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Saving data for ZG88444: {'auction_closing_time': 1774714192.0, 'created_time': 1774553203.739817, 'last_price_update_time': 1774676423.006307}
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG88444') HTTP/1.1" 204 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL37075%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for EL37075: 2
2026-03-28 05:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with identifier: EL37075
2026-03-28 05:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with scrape type 2
2026-03-28 05:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with scrape type 2
2026-03-28 05:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d, identifier: EL37075
2026-03-28 05:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with identifier: EL37075
2026-03-28 05:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with identifier: EL37075
2026-03-28 05:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 797b62c9-6c6f-5fb3-97ae-83ae66d5e86d with identifier: EL37075 to the API
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:41:41Z',
 'fuel_type': 'petrol',
 'id': '797b62c9-6c6f-5fb3-97ae-83ae66d5e86d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL37075',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 156492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Roncalli Trendline',
 'transmission': 'manual',
 'trim': 'Roncalli Trendline',
 'year': 2012}
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL37075%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Saving data for EL37075: {'auction_closing_time': 1774716101.0, 'created_time': 1774468229.171237, 'last_price_update_time': 1774676423.582702}
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL37075') HTTP/1.1" 204 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for AX08023: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for VU06993: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW80989%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for XW80989: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-28 05:40:23 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40522%27 HTTP/1.1" 200 None
2026-03-28 05:40:23 [auto1.de] INFO: Scrape type for SN40522: 2
2026-03-28 05:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5a3754-e083-51b2-bcf6-118e584c5f98 with identifier: SN40522
2026-03-28 05:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5a3754-e083-51b2-bcf6-118e584c5f98 with scrape type 2
2026-03-28 05:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad5a3754-e083-51b2-bcf6-118e584c5f98 with scrape type 2
2026-03-28 05:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad5a3754-e083-51b2-bcf6-118e584c5f98, identifier: SN40522
2026-03-28 05:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad5a3754-e083-51b2-bcf6-118e584c5f98 with identifier: SN40522
2026-03-28 05:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad5a3754-e083-51b2-bcf6-118e584c5f98 with identifier: SN40522
2026-03-28 05:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad5a3754-e083-51b2-bcf6-118e584c5f98 with identifier: SN40522 to the API
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:05:42Z',
 'fuel_type': 'petrol',
 'id': 'ad5a3754-e083-51b2-bcf6-118e584c5f98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN40522',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 200009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-14',
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Energy Roadster Coupe',
 'transmission': 'manual',
 'trim': 'Energy Roadster Coupe',
 'year': 2007}
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40522%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Saving data for SN40522: {'auction_closing_time': 1774713942.0, 'created_time': 1774466704.343444, 'last_price_update_time': 1774676424.097179}
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN40522') HTTP/1.1" 204 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF52194%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for SF52194: 2
2026-03-28 05:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a56767-578a-514c-ad61-93aae010d542 with identifier: SF52194
2026-03-28 05:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a56767-578a-514c-ad61-93aae010d542 with scrape type 2
2026-03-28 05:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76a56767-578a-514c-ad61-93aae010d542 with scrape type 2
2026-03-28 05:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a56767-578a-514c-ad61-93aae010d542, identifier: SF52194
2026-03-28 05:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a56767-578a-514c-ad61-93aae010d542 with identifier: SF52194
2026-03-28 05:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a56767-578a-514c-ad61-93aae010d542 with identifier: SF52194
2026-03-28 05:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a56767-578a-514c-ad61-93aae010d542 with identifier: SF52194 to the API
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:48:10Z',
 'fuel_type': 'diesel',
 'id': '76a56767-578a-514c-ad61-93aae010d542',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF52194',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 190143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF52194%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Saving data for SF52194: {'auction_closing_time': 1774716490.0, 'created_time': 1774467494.573773, 'last_price_update_time': 1774676424.621473}
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF52194') HTTP/1.1" 204 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-28 05:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:24 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA56471%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for LA56471: 0
2026-03-28 05:40:24 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-28 05:40:24 [auto1.de] INFO: Scrape type for MK79183: 2
2026-03-28 05:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-28 05:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a2b027-5730-565e-ba24-77475815b5c4 with scrape type 2
2026-03-28 05:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a2b027-5730-565e-ba24-77475815b5c4 with scrape type 2
2026-03-28 05:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a2b027-5730-565e-ba24-77475815b5c4, identifier: MK79183
2026-03-28 05:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-28 05:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-28 05:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183 to the API
2026-03-28 05:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-28T16:33:03Z',
 'fuel_type': 'petrol',
 'id': '92a2b027-5730-565e-ba24-77475815b5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK79183',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 72237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-28 05:40:25 [auto1.de] INFO: Saving data for MK79183: {'auction_closing_time': 1774715583.0, 'created_time': 1774552364.024809, 'last_price_update_time': 1774676425.18738}
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK79183') HTTP/1.1" 204 0
2026-03-28 05:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:25 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-28 05:40:25 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-28 05:40:25 [auto1.de] INFO: Scrape type for BR43966: 2
2026-03-28 05:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-28 05:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f74838-e024-5187-a02f-88ee3aed9c0c with scrape type 2
2026-03-28 05:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f74838-e024-5187-a02f-88ee3aed9c0c with scrape type 2
2026-03-28 05:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9f74838-e024-5187-a02f-88ee3aed9c0c, identifier: BR43966
2026-03-28 05:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-28 05:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-28 05:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966 to the API
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:09:54Z',
 'fuel_type': 'petrol',
 'id': 'f9f74838-e024-5187-a02f-88ee3aed9c0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR43966',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 96012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-28 05:40:25 [auto1.de] INFO: Saving data for BR43966: {'auction_closing_time': 1774714194.0, 'created_time': 1774552628.868955, 'last_price_update_time': 1774676425.608025}
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR43966') HTTP/1.1" 204 0
2026-03-28 05:40:25 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-28 05:40:25 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-28 05:40:25 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-28 05:40:25 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39161%27 HTTP/1.1" 200 None
2026-03-28 05:40:25 [auto1.de] INFO: Scrape type for ST39161: 2
2026-03-28 05:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80e2a364-0073-5e33-afaa-49c90874cd56 with identifier: ST39161
2026-03-28 05:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80e2a364-0073-5e33-afaa-49c90874cd56 with scrape type 2
2026-03-28 05:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80e2a364-0073-5e33-afaa-49c90874cd56 with scrape type 2
2026-03-28 05:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80e2a364-0073-5e33-afaa-49c90874cd56, identifier: ST39161
2026-03-28 05:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80e2a364-0073-5e33-afaa-49c90874cd56 with identifier: ST39161
2026-03-28 05:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80e2a364-0073-5e33-afaa-49c90874cd56 with identifier: ST39161
2026-03-28 05:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80e2a364-0073-5e33-afaa-49c90874cd56 with identifier: ST39161 to the API
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:56:00Z',
 'fuel_type': 'petrol',
 'id': '80e2a364-0073-5e33-afaa-49c90874cd56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST39161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 41427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39161%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Saving data for ST39161: {'auction_closing_time': 1774716960.0, 'created_time': 1773304059.466452, 'last_price_update_time': 1774676426.07773}
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST39161') HTTP/1.1" 204 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ47476%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for CJ47476: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for MB08927: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG51690%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for AG51690: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for KS41473: 2
2026-03-28 05:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-28 05:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e46149-a690-5911-b61a-fdb81dbf7aa0 with scrape type 2
2026-03-28 05:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e46149-a690-5911-b61a-fdb81dbf7aa0 with scrape type 2
2026-03-28 05:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e46149-a690-5911-b61a-fdb81dbf7aa0, identifier: KS41473
2026-03-28 05:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-28 05:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-28 05:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473 to the API
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'petrol',
 'id': '39e46149-a690-5911-b61a-fdb81dbf7aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS41473',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 111019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Saving data for KS41473: {'auction_closing_time': 1774713646.0, 'created_time': 1774553230.302543, 'last_price_update_time': 1774676426.689814}
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS41473') HTTP/1.1" 204 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43250%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for AC43250: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: PB72951
2026-03-28 05:40:26 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-28 05:40:26 [auto1.de] INFO: Scrape type for WM94615: 2
2026-03-28 05:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-28 05:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7759d26-2a61-5c2c-8fac-5add08f583ce with scrape type 2
2026-03-28 05:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7759d26-2a61-5c2c-8fac-5add08f583ce with scrape type 2
2026-03-28 05:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7759d26-2a61-5c2c-8fac-5add08f583ce, identifier: WM94615
2026-03-28 05:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-28 05:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-28 05:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615 to the API
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:59:07Z',
 'fuel_type': 'hybrid',
 'id': 'c7759d26-2a61-5c2c-8fac-5add08f583ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM94615',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 28802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Saving data for WM94615: {'auction_closing_time': 1774717147.0, 'created_time': 1774463939.690744, 'last_price_update_time': 1774676427.298307}
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM94615') HTTP/1.1" 204 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB49845%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for DB49845: 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN07032%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for FN07032: 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF26861%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for UF26861: 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG57857%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for SG57857: 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN13180%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for XN13180: 2
2026-03-28 05:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0974f1-c96b-526f-a7a1-375f5934cf41 with identifier: XN13180
2026-03-28 05:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0974f1-c96b-526f-a7a1-375f5934cf41 with scrape type 2
2026-03-28 05:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d0974f1-c96b-526f-a7a1-375f5934cf41 with scrape type 2
2026-03-28 05:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d0974f1-c96b-526f-a7a1-375f5934cf41, identifier: XN13180
2026-03-28 05:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d0974f1-c96b-526f-a7a1-375f5934cf41 with identifier: XN13180
2026-03-28 05:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d0974f1-c96b-526f-a7a1-375f5934cf41 with identifier: XN13180
2026-03-28 05:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d0974f1-c96b-526f-a7a1-375f5934cf41 with identifier: XN13180 to the API
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:34:20Z',
 'fuel_type': 'petrol',
 'id': '2d0974f1-c96b-526f-a7a1-375f5934cf41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN13180',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 154796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-29',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN13180%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Saving data for XN13180: {'auction_closing_time': 1774715660.0, 'created_time': 1774466660.141652, 'last_price_update_time': 1774676427.818234}
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN13180') HTTP/1.1" 204 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for LE51560: 0
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-28 05:40:27 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43774%27 HTTP/1.1" 200 None
2026-03-28 05:40:27 [auto1.de] INFO: Scrape type for BV43774: 2
2026-03-28 05:40:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17a76e93-67e5-5022-bc40-3ce515fd35ac with identifier: BV43774
2026-03-28 05:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17a76e93-67e5-5022-bc40-3ce515fd35ac with scrape type 2
2026-03-28 05:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17a76e93-67e5-5022-bc40-3ce515fd35ac with scrape type 2
2026-03-28 05:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17a76e93-67e5-5022-bc40-3ce515fd35ac, identifier: BV43774
2026-03-28 05:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17a76e93-67e5-5022-bc40-3ce515fd35ac with identifier: BV43774
2026-03-28 05:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17a76e93-67e5-5022-bc40-3ce515fd35ac with identifier: BV43774
2026-03-28 05:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17a76e93-67e5-5022-bc40-3ce515fd35ac with identifier: BV43774 to the API
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:58Z',
 'fuel_type': 'diesel',
 'id': '17a76e93-67e5-5022-bc40-3ce515fd35ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV43774',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 290000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-01-21',
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI Atlantis',
 'transmission': 'manual',
 'trim': 'Atlantis',
 'year': 1999}
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43774%27 HTTP/1.1" 200 None
2026-03-28 05:40:28 [auto1.de] INFO: Saving data for BV43774: {'auction_closing_time': 1774715098.0, 'created_time': 1774503339.835173, 'last_price_update_time': 1774676428.426421}
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV43774') HTTP/1.1" 204 0
2026-03-28 05:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:29 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP05146%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for XP05146: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH33807%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for JH33807: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM56474%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for UM56474: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA62808%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for AA62808: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for LN76006: 0
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: KA74482
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-28 05:40:29 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Scrape type for LX71576: 2
2026-03-28 05:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-28 05:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293dd7c6-a744-58a2-8626-73ecc313287b with scrape type 2
2026-03-28 05:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293dd7c6-a744-58a2-8626-73ecc313287b with scrape type 2
2026-03-28 05:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293dd7c6-a744-58a2-8626-73ecc313287b, identifier: LX71576
2026-03-28 05:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-28 05:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-28 05:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576 to the API
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-28T16:28:43Z',
 'fuel_type': 'petrol',
 'id': '293dd7c6-a744-58a2-8626-73ecc313287b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX71576',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 120581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-08',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-28 05:40:29 [auto1.de] INFO: Saving data for LX71576: {'auction_closing_time': 1774715323.0, 'created_time': 1774550920.995869, 'last_price_update_time': 1774676429.980262}
2026-03-28 05:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX71576') HTTP/1.1" 204 0
2026-03-28 05:40:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for AC69838: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12884%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for PR12884: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT99648%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for NT99648: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS92779%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for YS92779: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for JY95314: 2
2026-03-28 05:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-28 05:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1759de39-4886-5a05-abf4-3a5f6dd05d6a with scrape type 2
2026-03-28 05:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1759de39-4886-5a05-abf4-3a5f6dd05d6a with scrape type 2
2026-03-28 05:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1759de39-4886-5a05-abf4-3a5f6dd05d6a, identifier: JY95314
2026-03-28 05:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-28 05:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-28 05:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314 to the API
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-28T16:09:33Z',
 'fuel_type': 'petrol',
 'id': '1759de39-4886-5a05-abf4-3a5f6dd05d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY95314',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 178544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Audi A6 3.2 V6 FSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Saving data for JY95314: {'auction_closing_time': 1774714173.0, 'created_time': 1773341673.329699, 'last_price_update_time': 1774676430.597288}
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY95314') HTTP/1.1" 204 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for XH94103: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS84249%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for TS84249: 0
2026-03-28 05:40:30 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ89633%27 HTTP/1.1" 200 None
2026-03-28 05:40:30 [auto1.de] INFO: Scrape type for JJ89633: 2
2026-03-28 05:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03d24c8b-8b13-50df-bba4-2d8bcb751655 with identifier: JJ89633
2026-03-28 05:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03d24c8b-8b13-50df-bba4-2d8bcb751655 with scrape type 2
2026-03-28 05:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03d24c8b-8b13-50df-bba4-2d8bcb751655 with scrape type 2
2026-03-28 05:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03d24c8b-8b13-50df-bba4-2d8bcb751655, identifier: JJ89633
2026-03-28 05:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03d24c8b-8b13-50df-bba4-2d8bcb751655 with identifier: JJ89633
2026-03-28 05:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03d24c8b-8b13-50df-bba4-2d8bcb751655 with identifier: JJ89633
2026-03-28 05:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03d24c8b-8b13-50df-bba4-2d8bcb751655 with identifier: JJ89633 to the API
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:45:44Z',
 'fuel_type': 'petrol',
 'id': '03d24c8b-8b13-50df-bba4-2d8bcb751655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ89633',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 101749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-04',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Kasten EcoProfi',
 'transmission': 'manual',
 'trim': 'Kasten EcoProfi',
 'year': 2014}
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ89633%27 HTTP/1.1" 200 None
2026-03-28 05:40:31 [auto1.de] INFO: Saving data for JJ89633: {'auction_closing_time': 1774716344.0, 'created_time': 1774468034.823774, 'last_price_update_time': 1774676431.27114}
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ89633') HTTP/1.1" 204 0
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-28 05:40:31 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-28 05:40:31 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM90514%27 HTTP/1.1" 200 None
2026-03-28 05:40:31 [auto1.de] INFO: Scrape type for PM90514: 0
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 05:40:31 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-28 05:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:32 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:32 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF95135%27 HTTP/1.1" 200 None
2026-03-28 05:40:32 [auto1.de] INFO: Scrape type for SF95135: 2
2026-03-28 05:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with identifier: SF95135
2026-03-28 05:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with scrape type 2
2026-03-28 05:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with scrape type 2
2026-03-28 05:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27812b7a-1af0-512b-a8ef-6ce72eaf9ade, identifier: SF95135
2026-03-28 05:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with identifier: SF95135
2026-03-28 05:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with identifier: SF95135
2026-03-28 05:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27812b7a-1af0-512b-a8ef-6ce72eaf9ade with identifier: SF95135 to the API
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:00:38Z',
 'fuel_type': 'diesel',
 'id': '27812b7a-1af0-512b-a8ef-6ce72eaf9ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF95135',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 110878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-16',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF95135%27 HTTP/1.1" 200 None
2026-03-28 05:40:32 [auto1.de] INFO: Saving data for SF95135: {'auction_closing_time': 1774713638.0, 'created_time': 1774466606.485762, 'last_price_update_time': 1774676432.940129}
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF95135') HTTP/1.1" 204 0
2026-03-28 05:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Scrape type for CA65942: 2
2026-03-28 05:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-28 05:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with scrape type 2
2026-03-28 05:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with scrape type 2
2026-03-28 05:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4, identifier: CA65942
2026-03-28 05:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-28 05:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-28 05:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942 to the API
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:22:08Z',
 'fuel_type': 'diesel',
 'id': 'e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA65942',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 106856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Saving data for CA65942: {'auction_closing_time': 1774714928.0, 'created_time': 1774552912.713365, 'last_price_update_time': 1774676433.46131}
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA65942') HTTP/1.1" 204 0
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL13206%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Scrape type for RL13206: 0
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-28 05:40:33 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Scrape type for HY14352: 2
2026-03-28 05:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-28 05:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with scrape type 2
2026-03-28 05:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with scrape type 2
2026-03-28 05:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9d3f12-6f4a-53ac-8191-9ce12fc77467, identifier: HY14352
2026-03-28 05:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-28 05:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-28 05:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352 to the API
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:49Z',
 'fuel_type': 'diesel',
 'id': 'ef9d3f12-6f4a-53ac-8191-9ce12fc77467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY14352',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 104142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang Edition Score',
 'transmission': 'automatic',
 'trim': 'lang Edition Score',
 'year': 2017}
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-28 05:40:33 [auto1.de] INFO: Saving data for HY14352: {'auction_closing_time': 1774717009.0, 'created_time': 1773132761.432819, 'last_price_update_time': 1774676433.979423}
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY14352') HTTP/1.1" 204 0
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23969%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Scrape type for MR23969: 0
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Scrape type for JV02966: 2
2026-03-28 05:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-28 05:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d3147d4-748e-58f3-973c-80100afe4a68 with scrape type 2
2026-03-28 05:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d3147d4-748e-58f3-973c-80100afe4a68 with scrape type 2
2026-03-28 05:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d3147d4-748e-58f3-973c-80100afe4a68, identifier: JV02966
2026-03-28 05:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-28 05:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966
2026-03-28 05:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d3147d4-748e-58f3-973c-80100afe4a68 with identifier: JV02966 to the API
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:14Z',
 'fuel_type': 'diesel',
 'id': '3d3147d4-748e-58f3-973c-80100afe4a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV02966',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 136836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Saving data for JV02966: {'auction_closing_time': 1774716134.0, 'created_time': 1774467738.557716, 'last_price_update_time': 1774676434.529252}
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV02966') HTTP/1.1" 204 0
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Scrape type for LF76340: 0
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76196%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Scrape type for PB76196: 0
2026-03-28 05:40:34 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-28 05:40:34 [auto1.de] INFO: Scrape type for WP86079: 2
2026-03-28 05:40:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-28 05:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with scrape type 2
2026-03-28 05:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with scrape type 2
2026-03-28 05:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb, identifier: WP86079
2026-03-28 05:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-28 05:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-28 05:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079 to the API
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:47:55Z',
 'fuel_type': 'petrol',
 'id': 'a6a9ca4f-4a4b-5547-beb1-e61a0974eedb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP86079',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 147390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-28 05:40:35 [auto1.de] INFO: Saving data for WP86079: {'auction_closing_time': 1774716475.0, 'created_time': 1774550732.379042, 'last_price_update_time': 1774676435.028729}
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP86079') HTTP/1.1" 204 0
2026-03-28 05:40:35 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 05:40:35 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-28 05:40:35 [auto1.de] INFO: Scrape type for NE13487: 2
2026-03-28 05:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-28 05:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with scrape type 2
2026-03-28 05:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with scrape type 2
2026-03-28 05:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde, identifier: NE13487
2026-03-28 05:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-28 05:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-28 05:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487 to the API
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:56Z',
 'fuel_type': 'diesel',
 'id': 'c5f9ad73-ba97-5a5e-930d-df2dd2ffefde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE13487',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 125241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Elegance 4x4',
 'transmission': 'manual',
 'trim': 'Elegance 4x4',
 'year': 2011}
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-28 05:40:35 [auto1.de] INFO: Saving data for NE13487: {'auction_closing_time': 1774714196.0, 'created_time': 1774552454.018884, 'last_price_update_time': 1774676435.579373}
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE13487') HTTP/1.1" 204 0
2026-03-28 05:40:35 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB31045%27 HTTP/1.1" 200 None
2026-03-28 05:40:35 [auto1.de] INFO: Scrape type for YB31045: 0
2026-03-28 05:40:35 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62953%27 HTTP/1.1" 200 None
2026-03-28 05:40:35 [auto1.de] INFO: Scrape type for WJ62953: 2
2026-03-28 05:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d34418b-44e7-57c3-a80a-52cbf74e57cf with identifier: WJ62953
2026-03-28 05:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d34418b-44e7-57c3-a80a-52cbf74e57cf with scrape type 2
2026-03-28 05:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d34418b-44e7-57c3-a80a-52cbf74e57cf with scrape type 2
2026-03-28 05:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d34418b-44e7-57c3-a80a-52cbf74e57cf, identifier: WJ62953
2026-03-28 05:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d34418b-44e7-57c3-a80a-52cbf74e57cf with identifier: WJ62953
2026-03-28 05:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d34418b-44e7-57c3-a80a-52cbf74e57cf with identifier: WJ62953
2026-03-28 05:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d34418b-44e7-57c3-a80a-52cbf74e57cf with identifier: WJ62953 to the API
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:16:07Z',
 'fuel_type': 'petrol',
 'id': '6d34418b-44e7-57c3-a80a-52cbf74e57cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ62953',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 54584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62953%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Saving data for WJ62953: {'auction_closing_time': 1774714567.0, 'created_time': 1774466588.334129, 'last_price_update_time': 1774676436.023067}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ62953') HTTP/1.1" 204 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: GN74176
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR48020%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for RR48020: 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for NV16003: 2
2026-03-28 05:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-28 05:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ad063b-d86f-58bb-8504-c7ca8d13f88e with scrape type 2
2026-03-28 05:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ad063b-d86f-58bb-8504-c7ca8d13f88e with scrape type 2
2026-03-28 05:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3ad063b-d86f-58bb-8504-c7ca8d13f88e, identifier: NV16003
2026-03-28 05:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-28 05:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-28 05:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003 to the API
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:52:12Z',
 'fuel_type': 'diesel',
 'id': 'd3ad063b-d86f-58bb-8504-c7ca8d13f88e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV16003',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 64077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2022}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Saving data for NV16003: {'auction_closing_time': 1774716732.0, 'created_time': 1774552830.150485, 'last_price_update_time': 1774676436.48555}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV16003') HTTP/1.1" 204 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for DS59487: 2
2026-03-28 05:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-28 05:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e32d810-2d93-5885-ab75-6b6df5975b43 with scrape type 2
2026-03-28 05:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e32d810-2d93-5885-ab75-6b6df5975b43 with scrape type 2
2026-03-28 05:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e32d810-2d93-5885-ab75-6b6df5975b43, identifier: DS59487
2026-03-28 05:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-28 05:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-28 05:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487 to the API
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:43Z',
 'fuel_type': 'diesel',
 'id': '7e32d810-2d93-5885-ab75-6b6df5975b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS59487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 150524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Saving data for DS59487: {'auction_closing_time': 1774714363.0, 'created_time': 1773946849.334871, 'last_price_update_time': 1774676436.935673}
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS59487') HTTP/1.1" 204 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-28 05:40:36 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-28 05:40:36 [auto1.de] INFO: Scrape type for NH12576: 0
2026-03-28 05:40:36 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-28 05:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD80617%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for WD80617: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK38709%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for VK38709: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH99279%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for JH99279: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for AJ62547: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for ZC42699: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for FW21815: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for YL37879: 2
2026-03-28 05:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-28 05:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56afc06b-c288-5f67-a754-37faa251f5c2 with scrape type 2
2026-03-28 05:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56afc06b-c288-5f67-a754-37faa251f5c2 with scrape type 2
2026-03-28 05:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56afc06b-c288-5f67-a754-37faa251f5c2, identifier: YL37879
2026-03-28 05:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-28 05:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879
2026-03-28 05:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56afc06b-c288-5f67-a754-37faa251f5c2 with identifier: YL37879 to the API
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:51:11Z',
 'fuel_type': 'diesel',
 'id': '56afc06b-c288-5f67-a754-37faa251f5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL37879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Phaeton',
 'odometer': 302576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-05',
 'seller_name': None,
 'title': 'Volkswagen Phaeton 3.0 V6 TDI Lang 4Motion',
 'transmission': 'automatic',
 'trim': 'Lang 4Motion',
 'year': 2009}
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Saving data for YL37879: {'auction_closing_time': 1774716671.0, 'created_time': 1773227922.208218, 'last_price_update_time': 1774676437.579217}
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL37879') HTTP/1.1" 204 0
2026-03-28 05:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:37 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-28 05:40:37 [auto1.de] INFO: Scrape type for SZ45535: 2
2026-03-28 05:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-28 05:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448c4626-3197-55ff-8b47-89ee05427533 with scrape type 2
2026-03-28 05:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 448c4626-3197-55ff-8b47-89ee05427533 with scrape type 2
2026-03-28 05:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 448c4626-3197-55ff-8b47-89ee05427533, identifier: SZ45535
2026-03-28 05:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-28 05:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-28 05:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535 to the API
2026-03-28 05:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:07:59Z',
 'fuel_type': 'petrol',
 'id': '448c4626-3197-55ff-8b47-89ee05427533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ45535',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 37410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-28 05:40:38 [auto1.de] INFO: Saving data for SZ45535: {'auction_closing_time': 1774714079.0, 'created_time': 1774553246.576639, 'last_price_update_time': 1774676438.139963}
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ45535') HTTP/1.1" 204 0
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC30685%27 HTTP/1.1" 200 None
2026-03-28 05:40:38 [auto1.de] INFO: Scrape type for MC30685: 2
2026-03-28 05:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11c5810a-229d-55c6-888d-01cd39f82ba5 with identifier: MC30685
2026-03-28 05:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11c5810a-229d-55c6-888d-01cd39f82ba5 with scrape type 2
2026-03-28 05:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11c5810a-229d-55c6-888d-01cd39f82ba5 with scrape type 2
2026-03-28 05:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11c5810a-229d-55c6-888d-01cd39f82ba5, identifier: MC30685
2026-03-28 05:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11c5810a-229d-55c6-888d-01cd39f82ba5 with identifier: MC30685
2026-03-28 05:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11c5810a-229d-55c6-888d-01cd39f82ba5 with identifier: MC30685
2026-03-28 05:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11c5810a-229d-55c6-888d-01cd39f82ba5 with identifier: MC30685 to the API
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:09:37Z',
 'fuel_type': 'petrol',
 'id': '11c5810a-229d-55c6-888d-01cd39f82ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC30685',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 69625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC30685%27 HTTP/1.1" 200 None
2026-03-28 05:40:38 [auto1.de] INFO: Saving data for MC30685: {'auction_closing_time': 1774714177.0, 'created_time': 1773861794.147924, 'last_price_update_time': 1774676438.565652}
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC30685') HTTP/1.1" 204 0
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80875%27 HTTP/1.1" 200 None
2026-03-28 05:40:38 [auto1.de] INFO: Scrape type for DL80875: 0
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-28 05:40:38 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ09038%27 HTTP/1.1" 200 None
2026-03-28 05:40:38 [auto1.de] INFO: Scrape type for VJ09038: 2
2026-03-28 05:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7635596-2118-576b-9d82-1478c302e758 with identifier: VJ09038
2026-03-28 05:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7635596-2118-576b-9d82-1478c302e758 with scrape type 2
2026-03-28 05:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7635596-2118-576b-9d82-1478c302e758 with scrape type 2
2026-03-28 05:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7635596-2118-576b-9d82-1478c302e758, identifier: VJ09038
2026-03-28 05:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7635596-2118-576b-9d82-1478c302e758 with identifier: VJ09038
2026-03-28 05:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7635596-2118-576b-9d82-1478c302e758 with identifier: VJ09038
2026-03-28 05:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7635596-2118-576b-9d82-1478c302e758 with identifier: VJ09038 to the API
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:31:14Z',
 'fuel_type': 'petrol',
 'id': 'd7635596-2118-576b-9d82-1478c302e758',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ09038',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 113751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ09038%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Saving data for VJ09038: {'auction_closing_time': 1774715474.0, 'created_time': 1774466675.604958, 'last_price_update_time': 1774676439.017111}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ09038') HTTP/1.1" 204 0
2026-03-28 05:40:39 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89715%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Scrape type for FD89715: 2
2026-03-28 05:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178f4c32-dad3-5787-8521-28ac91dcd988 with identifier: FD89715
2026-03-28 05:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178f4c32-dad3-5787-8521-28ac91dcd988 with scrape type 2
2026-03-28 05:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 178f4c32-dad3-5787-8521-28ac91dcd988 with scrape type 2
2026-03-28 05:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 178f4c32-dad3-5787-8521-28ac91dcd988, identifier: FD89715
2026-03-28 05:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 178f4c32-dad3-5787-8521-28ac91dcd988 with identifier: FD89715
2026-03-28 05:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 178f4c32-dad3-5787-8521-28ac91dcd988 with identifier: FD89715
2026-03-28 05:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 178f4c32-dad3-5787-8521-28ac91dcd988 with identifier: FD89715 to the API
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:07:32Z',
 'fuel_type': 'petrol',
 'id': '178f4c32-dad3-5787-8521-28ac91dcd988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD89715',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 154196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89715%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Saving data for FD89715: {'auction_closing_time': 1774714052.0, 'created_time': 1774463883.510852, 'last_price_update_time': 1774676439.48813}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD89715') HTTP/1.1" 204 0
2026-03-28 05:40:39 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-28 05:40:39 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-28 05:40:39 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX76617%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Scrape type for ZX76617: 2
2026-03-28 05:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with identifier: ZX76617
2026-03-28 05:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with scrape type 2
2026-03-28 05:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with scrape type 2
2026-03-28 05:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2, identifier: ZX76617
2026-03-28 05:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with identifier: ZX76617
2026-03-28 05:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with identifier: ZX76617
2026-03-28 05:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42b70b22-37e8-5a6f-8b80-b5f9f336e7c2 with identifier: ZX76617 to the API
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:27Z',
 'fuel_type': 'diesel',
 'id': '42b70b22-37e8-5a6f-8b80-b5f9f336e7c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX76617',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 126728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2019}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX76617%27 HTTP/1.1" 200 None
2026-03-28 05:40:39 [auto1.de] INFO: Saving data for ZX76617: {'auction_closing_time': 1774716567.0, 'created_time': 1774468282.574062, 'last_price_update_time': 1774676439.926101}
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX76617') HTTP/1.1" 204 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH66319%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for VH66319: 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME61701%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for ME61701: 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW02492%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for CW02492: 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX22927%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for PX22927: 2
2026-03-28 05:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with identifier: PX22927
2026-03-28 05:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with scrape type 2
2026-03-28 05:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with scrape type 2
2026-03-28 05:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb, identifier: PX22927
2026-03-28 05:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with identifier: PX22927
2026-03-28 05:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with identifier: PX22927
2026-03-28 05:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb with identifier: PX22927 to the API
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:07:59Z',
 'fuel_type': 'petrol',
 'id': 'e166c97b-900c-5ecd-9fb8-c74bbbb3a3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX22927',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '306',
 'odometer': 169630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1994-07-14',
 'seller_name': None,
 'title': 'Peugeot 306 1.4 XR',
 'transmission': 'manual',
 'trim': 'XR',
 'year': 1994}
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX22927%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Saving data for PX22927: {'auction_closing_time': 1774714079.0, 'created_time': 1774467287.528482, 'last_price_update_time': 1774676440.541532}
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX22927') HTTP/1.1" 204 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY31497%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for RY31497: 0
2026-03-28 05:40:40 [auto1.de] INFO: Found listing with ID: NR66161
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR66161%27 HTTP/1.1" 200 None
2026-03-28 05:40:40 [auto1.de] INFO: Scrape type for NR66161: 0
2026-03-28 05:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:41 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:41 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-28 05:40:41 [auto1.de] INFO: Scrape type for TT40648: 2
2026-03-28 05:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-28 05:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9163067c-442a-5121-975c-052aa084495e with scrape type 2
2026-03-28 05:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9163067c-442a-5121-975c-052aa084495e with scrape type 2
2026-03-28 05:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9163067c-442a-5121-975c-052aa084495e, identifier: TT40648
2026-03-28 05:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-28 05:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-28 05:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648 to the API
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:42Z',
 'fuel_type': 'petrol',
 'id': '9163067c-442a-5121-975c-052aa084495e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT40648',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 71808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-28 05:40:41 [auto1.de] INFO: Saving data for TT40648: {'auction_closing_time': 1774715202.0, 'created_time': 1773946209.517288, 'last_price_update_time': 1774676441.785295}
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT40648') HTTP/1.1" 204 0
2026-03-28 05:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:41 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 05:40:41 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-28 05:40:41 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-28 05:40:41 [auto1.de] INFO: Scrape type for KA00227: 2
2026-03-28 05:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-28 05:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe56322-77e6-5d3c-a6f7-024072961226 with scrape type 2
2026-03-28 05:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe56322-77e6-5d3c-a6f7-024072961226 with scrape type 2
2026-03-28 05:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe56322-77e6-5d3c-a6f7-024072961226, identifier: KA00227
2026-03-28 05:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-28 05:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-28 05:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227 to the API
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:59Z',
 'fuel_type': 'diesel',
 'id': 'cfe56322-77e6-5d3c-a6f7-024072961226',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA00227',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 90363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.7 dCi Tekna+ 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna+ 4x4',
 'year': 2019}
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Saving data for KA00227: {'auction_closing_time': 1774714079.0, 'created_time': 1774552911.1823, 'last_price_update_time': 1774676442.260874}
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA00227') HTTP/1.1" 204 0
2026-03-28 05:40:42 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-28 05:40:42 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA67996%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Scrape type for PA67996: 2
2026-03-28 05:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with identifier: PA67996
2026-03-28 05:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with scrape type 2
2026-03-28 05:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with scrape type 2
2026-03-28 05:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f7b7d3-3a40-5a1e-aec5-9611bcdff420, identifier: PA67996
2026-03-28 05:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with identifier: PA67996
2026-03-28 05:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with identifier: PA67996
2026-03-28 05:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f7b7d3-3a40-5a1e-aec5-9611bcdff420 with identifier: PA67996 to the API
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:27Z',
 'fuel_type': 'diesel',
 'id': 'd0f7b7d3-3a40-5a1e-aec5-9611bcdff420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA67996',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 253230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA67996%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Saving data for PA67996: {'auction_closing_time': 1774716627.0, 'created_time': 1774468195.031392, 'last_price_update_time': 1774676442.797986}
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA67996') HTTP/1.1" 204 0
2026-03-28 05:40:42 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC74515%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Scrape type for VC74515: 0
2026-03-28 05:40:42 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW75764%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Scrape type for WW75764: 0
2026-03-28 05:40:42 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-28 05:40:42 [auto1.de] INFO: Scrape type for XF93739: 2
2026-03-28 05:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-28 05:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9124e27d-2ed1-552c-9400-b2b3115c9af8 with scrape type 2
2026-03-28 05:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9124e27d-2ed1-552c-9400-b2b3115c9af8 with scrape type 2
2026-03-28 05:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9124e27d-2ed1-552c-9400-b2b3115c9af8, identifier: XF93739
2026-03-28 05:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-28 05:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-28 05:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739 to the API
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-28T16:11:52Z',
 'fuel_type': 'petrol',
 'id': '9124e27d-2ed1-552c-9400-b2b3115c9af8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF93739',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 62305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 Convertible GT',
 'transmission': 'manual',
 'trim': 'Convertible GT',
 'year': 2017}
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Saving data for XF93739: {'auction_closing_time': 1774714312.0, 'created_time': 1774552683.292137, 'last_price_update_time': 1774676443.274705}
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF93739') HTTP/1.1" 204 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ46793%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for TZ46793: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR92682%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for LR92682: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP07657%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for JP07657: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA90244%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for FA90244: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS29154%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for TS29154: 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC76278%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Scrape type for WC76278: 2
2026-03-28 05:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with identifier: WC76278
2026-03-28 05:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with scrape type 2
2026-03-28 05:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with scrape type 2
2026-03-28 05:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98, identifier: WC76278
2026-03-28 05:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with identifier: WC76278
2026-03-28 05:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with identifier: WC76278
2026-03-28 05:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98 with identifier: WC76278 to the API
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:01Z',
 'fuel_type': 'diesel',
 'id': '01d2f3bc-bb96-5ed7-8ac4-a2e0dcf9fb98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC76278',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 262023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2015}
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC76278%27 HTTP/1.1" 200 None
2026-03-28 05:40:43 [auto1.de] INFO: Saving data for WC76278: {'auction_closing_time': 1774713661.0, 'created_time': 1774466793.069479, 'last_price_update_time': 1774676443.87187}
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC76278') HTTP/1.1" 204 0
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-28 05:40:43 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 05:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for US78573: 2
2026-03-28 05:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-28 05:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa959e98-3d5b-58be-9cc2-d89c53d12c3d with scrape type 2
2026-03-28 05:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa959e98-3d5b-58be-9cc2-d89c53d12c3d with scrape type 2
2026-03-28 05:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa959e98-3d5b-58be-9cc2-d89c53d12c3d, identifier: US78573
2026-03-28 05:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-28 05:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-28 05:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573 to the API
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:40:30Z',
 'fuel_type': 'petrol',
 'id': 'aa959e98-3d5b-58be-9cc2-d89c53d12c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US78573',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 185259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-21',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2014}
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Saving data for US78573: {'auction_closing_time': 1774716030.0, 'created_time': 1774552337.181942, 'last_price_update_time': 1774676444.459382}
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US78573') HTTP/1.1" 204 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for YJ10280: 2
2026-03-28 05:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-28 05:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4b55f0b-9487-50ef-befe-ebc07e00e869 with scrape type 2
2026-03-28 05:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4b55f0b-9487-50ef-befe-ebc07e00e869 with scrape type 2
2026-03-28 05:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4b55f0b-9487-50ef-befe-ebc07e00e869, identifier: YJ10280
2026-03-28 05:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-28 05:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-28 05:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280 to the API
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:14Z',
 'fuel_type': 'diesel',
 'id': 'e4b55f0b-9487-50ef-befe-ebc07e00e869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ10280',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 116433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 Diesel M Selection L2',
 'transmission': 'manual',
 'trim': 'M Selection L2',
 'year': 2020}
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Saving data for YJ10280: {'auction_closing_time': 1774716794.0, 'created_time': 1774463903.679252, 'last_price_update_time': 1774676444.892022}
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ10280') HTTP/1.1" 204 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU60081%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for CU60081: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65322%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for LJ65322: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH74270%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for PH74270: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX03854%27 HTTP/1.1" 200 None
2026-03-28 05:40:44 [auto1.de] INFO: Scrape type for ZX03854: 0
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 05:40:44 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-28 05:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:45 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for CT53281: 2
2026-03-28 05:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-28 05:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with scrape type 2
2026-03-28 05:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with scrape type 2
2026-03-28 05:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c, identifier: CT53281
2026-03-28 05:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-28 05:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281
2026-03-28 05:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37b5fbd7-b18e-51e5-9850-2b308e20cd2c with identifier: CT53281 to the API
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:02:49Z',
 'fuel_type': 'diesel',
 'id': '37b5fbd7-b18e-51e5-9850-2b308e20cd2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT53281',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 180176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2021}
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Saving data for CT53281: {'auction_closing_time': 1774713769.0, 'created_time': 1774503332.166283, 'last_price_update_time': 1774676445.550751}
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT53281') HTTP/1.1" 204 0
2026-03-28 05:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for XE05025: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for WX92371: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84817%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for KC84817: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for UB19219: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM18767%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for BM18767: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for HE72355: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-28 05:40:45 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-28 05:40:45 [auto1.de] INFO: Scrape type for TT67137: 2
2026-03-28 05:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-28 05:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc70e1e0-8790-5fe8-963e-604615959a4b with scrape type 2
2026-03-28 05:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc70e1e0-8790-5fe8-963e-604615959a4b with scrape type 2
2026-03-28 05:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc70e1e0-8790-5fe8-963e-604615959a4b, identifier: TT67137
2026-03-28 05:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-28 05:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-28 05:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137 to the API
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:07:42Z',
 'fuel_type': 'petrol',
 'id': 'fc70e1e0-8790-5fe8-963e-604615959a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT67137',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 45767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2017}
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-28 05:40:46 [auto1.de] INFO: Saving data for TT67137: {'auction_closing_time': 1774714062.0, 'created_time': 1774553198.187595, 'last_price_update_time': 1774676446.26254}
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT67137') HTTP/1.1" 204 0
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-28 05:40:46 [auto1.de] INFO: Scrape type for DK51297: 2
2026-03-28 05:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-28 05:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with scrape type 2
2026-03-28 05:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with scrape type 2
2026-03-28 05:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3, identifier: DK51297
2026-03-28 05:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-28 05:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-28 05:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297 to the API
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:51:39Z',
 'fuel_type': 'petrol',
 'id': '8ac9bbd5-9f82-5095-a25c-72ef9739b4f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51297',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 99820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2019}
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-28 05:40:46 [auto1.de] INFO: Saving data for DK51297: {'auction_closing_time': 1774716699.0, 'created_time': 1774552995.875226, 'last_price_update_time': 1774676446.839863}
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK51297') HTTP/1.1" 204 0
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX26579%27 HTTP/1.1" 200 None
2026-03-28 05:40:46 [auto1.de] INFO: Scrape type for WX26579: 0
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 05:40:46 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR46257%27 HTTP/1.1" 200 None
2026-03-28 05:40:46 [auto1.de] INFO: Scrape type for DR46257: 2
2026-03-28 05:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1edd0fd-155b-50f9-bdcc-b407211d4edb with identifier: DR46257
2026-03-28 05:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1edd0fd-155b-50f9-bdcc-b407211d4edb with scrape type 2
2026-03-28 05:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1edd0fd-155b-50f9-bdcc-b407211d4edb with scrape type 2
2026-03-28 05:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1edd0fd-155b-50f9-bdcc-b407211d4edb, identifier: DR46257
2026-03-28 05:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1edd0fd-155b-50f9-bdcc-b407211d4edb with identifier: DR46257
2026-03-28 05:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1edd0fd-155b-50f9-bdcc-b407211d4edb with identifier: DR46257
2026-03-28 05:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1edd0fd-155b-50f9-bdcc-b407211d4edb with identifier: DR46257 to the API
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:46:55Z',
 'fuel_type': 'petrol',
 'id': 'c1edd0fd-155b-50f9-bdcc-b407211d4edb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR46257',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 44776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2018}
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR46257%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Saving data for DR46257: {'auction_closing_time': 1774716415.0, 'created_time': 1774467686.509124, 'last_price_update_time': 1774676447.300086}
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR46257') HTTP/1.1" 204 0
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Scrape type for XC72019: 0
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Scrape type for JG35367: 0
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF67733%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Scrape type for TF67733: 0
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Scrape type for DP00162: 0
2026-03-28 05:40:47 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98642%27 HTTP/1.1" 200 None
2026-03-28 05:40:47 [auto1.de] INFO: Scrape type for FA98642: 0
2026-03-28 05:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:48 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ38519%27 HTTP/1.1" 200 None
2026-03-28 05:40:48 [auto1.de] INFO: Scrape type for RJ38519: 0
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA68070%27 HTTP/1.1" 200 None
2026-03-28 05:40:48 [auto1.de] INFO: Scrape type for CA68070: 2
2026-03-28 05:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3002d3-89c1-5aea-8cdf-df975781c520 with identifier: CA68070
2026-03-28 05:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3002d3-89c1-5aea-8cdf-df975781c520 with scrape type 2
2026-03-28 05:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf3002d3-89c1-5aea-8cdf-df975781c520 with scrape type 2
2026-03-28 05:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3002d3-89c1-5aea-8cdf-df975781c520, identifier: CA68070
2026-03-28 05:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3002d3-89c1-5aea-8cdf-df975781c520 with identifier: CA68070
2026-03-28 05:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3002d3-89c1-5aea-8cdf-df975781c520 with identifier: CA68070
2026-03-28 05:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3002d3-89c1-5aea-8cdf-df975781c520 with identifier: CA68070 to the API
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:06Z',
 'fuel_type': 'diesel',
 'id': 'cf3002d3-89c1-5aea-8cdf-df975781c520',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA68070',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 330614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA68070%27 HTTP/1.1" 200 None
2026-03-28 05:40:48 [auto1.de] INFO: Saving data for CA68070: {'auction_closing_time': 1774715706.0, 'created_time': 1774466922.188486, 'last_price_update_time': 1774676448.712587}
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA68070') HTTP/1.1" 204 0
2026-03-28 05:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:48 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS97270%27 HTTP/1.1" 200 None
2026-03-28 05:40:48 [auto1.de] INFO: Scrape type for TS97270: 2
2026-03-28 05:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf0bd77-8c9a-5fb7-8231-220172429369 with identifier: TS97270
2026-03-28 05:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf0bd77-8c9a-5fb7-8231-220172429369 with scrape type 2
2026-03-28 05:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bf0bd77-8c9a-5fb7-8231-220172429369 with scrape type 2
2026-03-28 05:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf0bd77-8c9a-5fb7-8231-220172429369, identifier: TS97270
2026-03-28 05:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf0bd77-8c9a-5fb7-8231-220172429369 with identifier: TS97270
2026-03-28 05:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf0bd77-8c9a-5fb7-8231-220172429369 with identifier: TS97270
2026-03-28 05:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf0bd77-8c9a-5fb7-8231-220172429369 with identifier: TS97270 to the API
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:07:20Z',
 'fuel_type': 'diesel',
 'id': '8bf0bd77-8c9a-5fb7-8231-220172429369',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS97270',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 115605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS97270%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Saving data for TS97270: {'auction_closing_time': 1774714040.0, 'created_time': 1774468194.079909, 'last_price_update_time': 1774676449.304056}
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS97270') HTTP/1.1" 204 0
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00170%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Scrape type for YY00170: 0
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW63189%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Scrape type for YW63189: 0
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Scrape type for LT13241: 2
2026-03-28 05:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-28 05:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e88029d-27a2-558e-b720-a7660872eaa9 with scrape type 2
2026-03-28 05:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e88029d-27a2-558e-b720-a7660872eaa9 with scrape type 2
2026-03-28 05:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e88029d-27a2-558e-b720-a7660872eaa9, identifier: LT13241
2026-03-28 05:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-28 05:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-28 05:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241 to the API
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'diesel',
 'id': '0e88029d-27a2-558e-b720-a7660872eaa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT13241',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 62149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-18',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 BLUE dCi Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2022}
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Saving data for LT13241: {'auction_closing_time': 1774716301.0, 'created_time': 1774553232.722356, 'last_price_update_time': 1774676449.778772}
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT13241') HTTP/1.1" 204 0
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80467%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Scrape type for DL80467: 0
2026-03-28 05:40:49 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-28 05:40:49 [auto1.de] INFO: Scrape type for YL76472: 2
2026-03-28 05:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-28 05:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with scrape type 2
2026-03-28 05:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with scrape type 2
2026-03-28 05:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27, identifier: YL76472
2026-03-28 05:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-28 05:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-28 05:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472 to the API
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': '592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL76472',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'BLS',
 'odometer': 195179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-24',
 'seller_name': None,
 'title': 'Cadillac BLS 2.0 Turbo Elegance Wagon',
 'transmission': 'manual',
 'trim': 'Elegance Wagon',
 'year': 2009}
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Saving data for YL76472: {'auction_closing_time': 1774716057.0, 'created_time': 1773916799.252689, 'last_price_update_time': 1774676450.213689}
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL76472') HTTP/1.1" 204 0
2026-03-28 05:40:50 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP13779%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Scrape type for LP13779: 0
2026-03-28 05:40:50 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Scrape type for EK27182: 2
2026-03-28 05:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-28 05:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with scrape type 2
2026-03-28 05:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with scrape type 2
2026-03-28 05:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91, identifier: EK27182
2026-03-28 05:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-28 05:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-28 05:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182 to the API
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:07Z',
 'fuel_type': 'diesel',
 'id': '8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK27182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 183913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Saving data for EK27182: {'auction_closing_time': 1774715047.0, 'created_time': 1774436944.480799, 'last_price_update_time': 1774676450.653679}
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK27182') HTTP/1.1" 204 0
2026-03-28 05:40:50 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-28 05:40:50 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA21059%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Scrape type for JA21059: 0
2026-03-28 05:40:50 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11677%27 HTTP/1.1" 200 None
2026-03-28 05:40:50 [auto1.de] INFO: Scrape type for MX11677: 2
2026-03-28 05:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da63e592-3208-5645-8d95-2d7eb015cb2c with identifier: MX11677
2026-03-28 05:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da63e592-3208-5645-8d95-2d7eb015cb2c with scrape type 2
2026-03-28 05:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da63e592-3208-5645-8d95-2d7eb015cb2c with scrape type 2
2026-03-28 05:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da63e592-3208-5645-8d95-2d7eb015cb2c, identifier: MX11677
2026-03-28 05:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da63e592-3208-5645-8d95-2d7eb015cb2c with identifier: MX11677
2026-03-28 05:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da63e592-3208-5645-8d95-2d7eb015cb2c with identifier: MX11677
2026-03-28 05:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da63e592-3208-5645-8d95-2d7eb015cb2c with identifier: MX11677 to the API
2026-03-28 05:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': 'da63e592-3208-5645-8d95-2d7eb015cb2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX11677',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 96466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Renault Megane 1.6 TCe Energy GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2017}
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11677%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Saving data for MX11677: {'auction_closing_time': 1774716068.0, 'created_time': 1774468016.109042, 'last_price_update_time': 1774676451.2119}
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX11677') HTTP/1.1" 204 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for XX85563: 2
2026-03-28 05:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-28 05:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with scrape type 2
2026-03-28 05:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with scrape type 2
2026-03-28 05:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be, identifier: XX85563
2026-03-28 05:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-28 05:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563
2026-03-28 05:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9576e0fa-5c69-52ab-a5a3-1ba72ed631be with identifier: XX85563 to the API
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:47:52Z',
 'fuel_type': 'petrol',
 'id': '9576e0fa-5c69-52ab-a5a3-1ba72ed631be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX85563',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 10614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-26',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2024}
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Saving data for XX85563: {'auction_closing_time': 1774716472.0, 'created_time': 1774467955.605558, 'last_price_update_time': 1774676451.657365}
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX85563') HTTP/1.1" 204 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE44885%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for XE44885: 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for ZU35501: 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX05743%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for JX05743: 0
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-28 05:40:51 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-28 05:40:51 [auto1.de] INFO: Scrape type for SG38319: 2
2026-03-28 05:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-28 05:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbef80c-3749-5475-898a-56d6d9ee56de with scrape type 2
2026-03-28 05:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecbef80c-3749-5475-898a-56d6d9ee56de with scrape type 2
2026-03-28 05:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecbef80c-3749-5475-898a-56d6d9ee56de, identifier: SG38319
2026-03-28 05:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-28 05:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-28 05:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319 to the API
2026-03-28 05:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:03:19Z',
 'fuel_type': 'petrol',
 'id': 'ecbef80c-3749-5475-898a-56d6d9ee56de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG38319',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 164539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2004}
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Saving data for SG38319: {'auction_closing_time': 1774713799.0, 'created_time': 1774351335.08232, 'last_price_update_time': 1774676452.212154}
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG38319') HTTP/1.1" 204 0
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: US71908
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71908%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Scrape type for US71908: 0
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73316%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Scrape type for PU73316: 0
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Scrape type for LB77280: 2
2026-03-28 05:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-28 05:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d38b927-1596-5744-a904-b6a169c0de3c with scrape type 2
2026-03-28 05:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d38b927-1596-5744-a904-b6a169c0de3c with scrape type 2
2026-03-28 05:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d38b927-1596-5744-a904-b6a169c0de3c, identifier: LB77280
2026-03-28 05:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-28 05:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-28 05:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280 to the API
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:00:42Z',
 'fuel_type': 'petrol',
 'id': '5d38b927-1596-5744-a904-b6a169c0de3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB77280',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 97670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Saving data for LB77280: {'auction_closing_time': 1774713642.0, 'created_time': 1774552731.026042, 'last_price_update_time': 1774676452.781207}
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB77280') HTTP/1.1" 204 0
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV44518%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Scrape type for AV44518: 0
2026-03-28 05:40:52 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-28 05:40:52 [auto1.de] INFO: Scrape type for UE92744: 2
2026-03-28 05:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-28 05:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737a427c-475b-5339-b455-8e3edba587d2 with scrape type 2
2026-03-28 05:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737a427c-475b-5339-b455-8e3edba587d2 with scrape type 2
2026-03-28 05:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 737a427c-475b-5339-b455-8e3edba587d2, identifier: UE92744
2026-03-28 05:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-28 05:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-28 05:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744 to the API
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:11:58Z',
 'fuel_type': 'diesel',
 'id': '737a427c-475b-5339-b455-8e3edba587d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE92744',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 161787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-28 05:40:53 [auto1.de] INFO: Saving data for UE92744: {'auction_closing_time': 1774714318.0, 'created_time': 1773946590.813389, 'last_price_update_time': 1774676453.275856}
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE92744') HTTP/1.1" 204 0
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-28 05:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:53 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH74007%27 HTTP/1.1" 200 None
2026-03-28 05:40:53 [auto1.de] INFO: Scrape type for JH74007: 0
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV97129%27 HTTP/1.1" 200 None
2026-03-28 05:40:53 [auto1.de] INFO: Scrape type for ZV97129: 0
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56057%27 HTTP/1.1" 200 None
2026-03-28 05:40:53 [auto1.de] INFO: Scrape type for XU56057: 0
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU46952%27 HTTP/1.1" 200 None
2026-03-28 05:40:53 [auto1.de] INFO: Scrape type for FU46952: 0
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: TC50609
2026-03-28 05:40:53 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-28 05:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN43229%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for SN43229: 0
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for RX17782: 2
2026-03-28 05:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-28 05:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with scrape type 2
2026-03-28 05:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with scrape type 2
2026-03-28 05:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0, identifier: RX17782
2026-03-28 05:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-28 05:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-28 05:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782 to the API
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-28T16:29:27Z',
 'fuel_type': 'diesel',
 'id': '7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX17782',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 143412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Saving data for RX17782: {'auction_closing_time': 1774715367.0, 'created_time': 1774550961.069592, 'last_price_update_time': 1774676454.415751}
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX17782') HTTP/1.1" 204 0
2026-03-28 05:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for JJ76956: 0
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ43252%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for BZ43252: 0
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC00549%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for AC00549: 0
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF79170%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for DF79170: 0
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: PJ00212
2026-03-28 05:40:54 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-28 05:40:54 [auto1.de] INFO: Scrape type for YY60165: 2
2026-03-28 05:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-28 05:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55892416-31bc-5f96-9fd3-387349d93948 with scrape type 2
2026-03-28 05:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55892416-31bc-5f96-9fd3-387349d93948 with scrape type 2
2026-03-28 05:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55892416-31bc-5f96-9fd3-387349d93948, identifier: YY60165
2026-03-28 05:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-28 05:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-28 05:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165 to the API
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:01Z',
 'fuel_type': 'diesel',
 'id': '55892416-31bc-5f96-9fd3-387349d93948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY60165',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 94413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Saving data for YY60165: {'auction_closing_time': 1774715161.0, 'created_time': 1774552705.193563, 'last_price_update_time': 1774676455.021981}
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY60165') HTTP/1.1" 204 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP89276%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for BP89276: 2
2026-03-28 05:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a866359-610e-5182-848f-1ae6645df3ee with identifier: BP89276
2026-03-28 05:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a866359-610e-5182-848f-1ae6645df3ee with scrape type 2
2026-03-28 05:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a866359-610e-5182-848f-1ae6645df3ee with scrape type 2
2026-03-28 05:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a866359-610e-5182-848f-1ae6645df3ee, identifier: BP89276
2026-03-28 05:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a866359-610e-5182-848f-1ae6645df3ee with identifier: BP89276
2026-03-28 05:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a866359-610e-5182-848f-1ae6645df3ee with identifier: BP89276
2026-03-28 05:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a866359-610e-5182-848f-1ae6645df3ee with identifier: BP89276 to the API
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:17:54Z',
 'fuel_type': 'petrol',
 'id': '4a866359-610e-5182-848f-1ae6645df3ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP89276',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 115462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-15',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP89276%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Saving data for BP89276: {'auction_closing_time': 1774714674.0, 'created_time': 1774551552.976515, 'last_price_update_time': 1774676455.439424}
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP89276') HTTP/1.1" 204 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01019%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for BX01019: 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ62910%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for KJ62910: 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for YN11150: 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for AE03495: 0
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-28 05:40:55 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-28 05:40:55 [auto1.de] INFO: Scrape type for DG70282: 2
2026-03-28 05:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-28 05:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2bf901-6d10-5105-96e6-0621254ba004 with scrape type 2
2026-03-28 05:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2bf901-6d10-5105-96e6-0621254ba004 with scrape type 2
2026-03-28 05:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a2bf901-6d10-5105-96e6-0621254ba004, identifier: DG70282
2026-03-28 05:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-28 05:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-28 05:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282 to the API
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:53Z',
 'fuel_type': 'petrol',
 'id': '7a2bf901-6d10-5105-96e6-0621254ba004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG70282',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 191678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2011}
2026-03-28 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-28 05:40:56 [auto1.de] INFO: Saving data for DG70282: {'auction_closing_time': 1774714793.0, 'created_time': 1774553114.258549, 'last_price_update_time': 1774676456.090053}
2026-03-28 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG70282') HTTP/1.1" 204 0
2026-03-28 05:40:56 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 05:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:40:56 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9199 | hits on page: 40
2026-03-28 05:40:56 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU71873%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for JU71873: 2
2026-03-28 05:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a6d8bc0-21be-529d-976a-167de5334612 with identifier: JU71873
2026-03-28 05:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a6d8bc0-21be-529d-976a-167de5334612 with scrape type 2
2026-03-28 05:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a6d8bc0-21be-529d-976a-167de5334612 with scrape type 2
2026-03-28 05:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a6d8bc0-21be-529d-976a-167de5334612, identifier: JU71873
2026-03-28 05:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a6d8bc0-21be-529d-976a-167de5334612 with identifier: JU71873
2026-03-28 05:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a6d8bc0-21be-529d-976a-167de5334612 with identifier: JU71873
2026-03-28 05:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a6d8bc0-21be-529d-976a-167de5334612 with identifier: JU71873 to the API
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:42:25Z',
 'fuel_type': 'petrol',
 'id': '6a6d8bc0-21be-529d-976a-167de5334612',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU71873',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 133585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-17',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2015}
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU71873%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Saving data for JU71873: {'auction_closing_time': 1774716145.0, 'created_time': 1774466226.735153, 'last_price_update_time': 1774676457.401027}
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU71873') HTTP/1.1" 204 0
2026-03-28 05:40:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ79327%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for PZ79327: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ16226%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for BJ16226: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX24097%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for MX24097: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79691%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for SP79691: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for ED91782: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH49621%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for EH49621: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT14311%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for YT14311: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG51855%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for JG51855: 0
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 05:40:57 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU42707%27 HTTP/1.1" 200 None
2026-03-28 05:40:57 [auto1.de] INFO: Scrape type for GU42707: 2
2026-03-28 05:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0ead74-b637-5761-8a48-ffe4b887277c with identifier: GU42707
2026-03-28 05:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0ead74-b637-5761-8a48-ffe4b887277c with scrape type 2
2026-03-28 05:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0ead74-b637-5761-8a48-ffe4b887277c with scrape type 2
2026-03-28 05:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb0ead74-b637-5761-8a48-ffe4b887277c, identifier: GU42707
2026-03-28 05:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb0ead74-b637-5761-8a48-ffe4b887277c with identifier: GU42707
2026-03-28 05:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb0ead74-b637-5761-8a48-ffe4b887277c with identifier: GU42707
2026-03-28 05:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb0ead74-b637-5761-8a48-ffe4b887277c with identifier: GU42707 to the API
2026-03-28 05:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:34Z',
 'fuel_type': 'diesel',
 'id': 'bb0ead74-b637-5761-8a48-ffe4b887277c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU42707',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 114478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU42707%27 HTTP/1.1" 200 None
2026-03-28 05:40:58 [auto1.de] INFO: Saving data for GU42707: {'auction_closing_time': 1774715614.0, 'created_time': 1774466663.148849, 'last_price_update_time': 1774676458.916383}
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU42707') HTTP/1.1" 204 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE65935%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for KE65935: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for HZ13557: 2
2026-03-28 05:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-28 05:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-28 05:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with scrape type 2
2026-03-28 05:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef, identifier: HZ13557
2026-03-28 05:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-28 05:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557
2026-03-28 05:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef with identifier: HZ13557 to the API
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:24:36Z',
 'fuel_type': 'petrol',
 'id': '8e4cb8ac-fc1b-5f53-9953-dcf779bcb4ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13557',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 145730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-10-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.6 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Saving data for HZ13557: {'auction_closing_time': 1774715076.0, 'created_time': 1774033521.558895, 'last_price_update_time': 1774676459.463348}
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13557') HTTP/1.1" 204 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54249%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for ZB54249: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW71463%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for SW71463: 0
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 05:40:59 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU50542%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Scrape type for NU50542: 2
2026-03-28 05:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f47e22-c5aa-5dd5-b594-6743d37611bf with identifier: NU50542
2026-03-28 05:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f47e22-c5aa-5dd5-b594-6743d37611bf with scrape type 2
2026-03-28 05:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30f47e22-c5aa-5dd5-b594-6743d37611bf with scrape type 2
2026-03-28 05:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30f47e22-c5aa-5dd5-b594-6743d37611bf, identifier: NU50542
2026-03-28 05:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30f47e22-c5aa-5dd5-b594-6743d37611bf with identifier: NU50542
2026-03-28 05:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30f47e22-c5aa-5dd5-b594-6743d37611bf with identifier: NU50542
2026-03-28 05:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30f47e22-c5aa-5dd5-b594-6743d37611bf with identifier: NU50542 to the API
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:01:58Z',
 'fuel_type': 'petrol',
 'id': '30f47e22-c5aa-5dd5-b594-6743d37611bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU50542',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 163640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2013}
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU50542%27 HTTP/1.1" 200 None
2026-03-28 05:40:59 [auto1.de] INFO: Saving data for NU50542: {'auction_closing_time': 1774713718.0, 'created_time': 1774466795.564251, 'last_price_update_time': 1774676459.952033}
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU50542') HTTP/1.1" 204 0
2026-03-28 05:41:00 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP25363%27 HTTP/1.1" 200 None
2026-03-28 05:41:00 [auto1.de] INFO: Scrape type for EP25363: 0
2026-03-28 05:41:00 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL49552%27 HTTP/1.1" 200 None
2026-03-28 05:41:00 [auto1.de] INFO: Scrape type for CL49552: 0
2026-03-28 05:41:00 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-28 05:41:00 [auto1.de] INFO: Scrape type for EW37787: 0
2026-03-28 05:41:00 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-28 05:41:00 [auto1.de] INFO: Scrape type for MP85459: 2
2026-03-28 05:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-28 05:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with scrape type 2
2026-03-28 05:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with scrape type 2
2026-03-28 05:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea4aaa36-ec19-5d55-a1b5-448ef94589b3, identifier: MP85459
2026-03-28 05:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-28 05:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459
2026-03-28 05:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea4aaa36-ec19-5d55-a1b5-448ef94589b3 with identifier: MP85459 to the API
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-28T16:44:33Z',
 'fuel_type': 'petrol',
 'id': 'ea4aaa36-ec19-5d55-a1b5-448ef94589b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP85459',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 126696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2019}
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-28 05:41:00 [auto1.de] INFO: Saving data for MP85459: {'auction_closing_time': 1774716273.0, 'created_time': 1774466613.157452, 'last_price_update_time': 1774676460.548501}
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP85459') HTTP/1.1" 204 0
2026-03-28 05:41:00 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-28 05:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:04 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for LU05399: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for VX06445: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC35405%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for GC35405: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM28055%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for XM28055: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41325%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for XJ41325: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-28 05:41:04 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS90051%27 HTTP/1.1" 200 None
2026-03-28 05:41:04 [auto1.de] INFO: Scrape type for NS90051: 0
2026-03-28 05:41:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:05 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: BR94807
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR94807%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Scrape type for BR94807: 0
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Scrape type for NZ25875: 0
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Scrape type for WZ27429: 2
2026-03-28 05:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-28 05:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5384a260-bcf8-5df6-9398-5dc2351ac375 with scrape type 2
2026-03-28 05:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5384a260-bcf8-5df6-9398-5dc2351ac375 with scrape type 2
2026-03-28 05:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5384a260-bcf8-5df6-9398-5dc2351ac375, identifier: WZ27429
2026-03-28 05:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-28 05:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-28 05:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429 to the API
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-28T16:41:58Z',
 'fuel_type': 'hybrid',
 'id': '5384a260-bcf8-5df6-9398-5dc2351ac375',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ27429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 97959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Kia Optima 2.0 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2015}
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Saving data for WZ27429: {'auction_closing_time': 1774716118.0, 'created_time': 1774552961.259229, 'last_price_update_time': 1774676465.668242}
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ27429') HTTP/1.1" 204 0
2026-03-28 05:41:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-28 05:41:05 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA24630%27 HTTP/1.1" 200 None
2026-03-28 05:41:05 [auto1.de] INFO: Scrape type for NA24630: 2
2026-03-28 05:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with identifier: NA24630
2026-03-28 05:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with scrape type 2
2026-03-28 05:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with scrape type 2
2026-03-28 05:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed, identifier: NA24630
2026-03-28 05:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with identifier: NA24630
2026-03-28 05:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with identifier: NA24630
2026-03-28 05:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b00f82a-1fa6-5e83-80a6-85f571ffd5ed with identifier: NA24630 to the API
2026-03-28 05:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:35:51Z',
 'fuel_type': 'petrol',
 'id': '2b00f82a-1fa6-5e83-80a6-85f571ffd5ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA24630',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 149091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA24630%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Saving data for NA24630: {'auction_closing_time': 1774715751.0, 'created_time': 1774467118.919237, 'last_price_update_time': 1774676466.191112}
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA24630') HTTP/1.1" 204 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for ZC43990: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for ZY80421: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ35057%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for FZ35057: 2
2026-03-28 05:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be66d12-4436-5081-a623-27f35f809e6f with identifier: FZ35057
2026-03-28 05:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be66d12-4436-5081-a623-27f35f809e6f with scrape type 2
2026-03-28 05:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be66d12-4436-5081-a623-27f35f809e6f with scrape type 2
2026-03-28 05:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be66d12-4436-5081-a623-27f35f809e6f, identifier: FZ35057
2026-03-28 05:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be66d12-4436-5081-a623-27f35f809e6f with identifier: FZ35057
2026-03-28 05:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be66d12-4436-5081-a623-27f35f809e6f with identifier: FZ35057
2026-03-28 05:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be66d12-4436-5081-a623-27f35f809e6f with identifier: FZ35057 to the API
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:36:57Z',
 'fuel_type': 'petrol',
 'id': '5be66d12-4436-5081-a623-27f35f809e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ35057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 118127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ35057%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Saving data for FZ35057: {'auction_closing_time': 1774715817.0, 'created_time': 1774468112.832979, 'last_price_update_time': 1774676466.733415}
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ35057') HTTP/1.1" 204 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for SJ63454: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP58013%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for PP58013: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43285%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for GG43285: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX33159%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for RX33159: 0
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 05:41:06 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN00069%27 HTTP/1.1" 200 None
2026-03-28 05:41:06 [auto1.de] INFO: Scrape type for PN00069: 2
2026-03-28 05:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 605b8684-837f-57ba-8e15-5d7aa70b5c96 with identifier: PN00069
2026-03-28 05:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 605b8684-837f-57ba-8e15-5d7aa70b5c96 with scrape type 2
2026-03-28 05:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 605b8684-837f-57ba-8e15-5d7aa70b5c96 with scrape type 2
2026-03-28 05:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 605b8684-837f-57ba-8e15-5d7aa70b5c96, identifier: PN00069
2026-03-28 05:41:06 [scrapy.extensions.logstats] INFO: Crawled 119 pages (at 16 pages/min), scraped 417 items (at 85 items/min)
2026-03-28 05:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 605b8684-837f-57ba-8e15-5d7aa70b5c96 with identifier: PN00069
2026-03-28 05:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 605b8684-837f-57ba-8e15-5d7aa70b5c96 with identifier: PN00069
2026-03-28 05:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 605b8684-837f-57ba-8e15-5d7aa70b5c96 with identifier: PN00069 to the API
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:20Z',
 'fuel_type': 'diesel',
 'id': '605b8684-837f-57ba-8e15-5d7aa70b5c96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN00069',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 359867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN00069%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Saving data for PN00069: {'auction_closing_time': 1774713860.0, 'created_time': 1774552821.068527, 'last_price_update_time': 1774676467.238984}
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN00069') HTTP/1.1" 204 0
2026-03-28 05:41:07 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 05:41:07 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Scrape type for AY74749: 2
2026-03-28 05:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-28 05:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc13f13-4c4a-58df-a257-56c19e997d7f with scrape type 2
2026-03-28 05:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc13f13-4c4a-58df-a257-56c19e997d7f with scrape type 2
2026-03-28 05:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acc13f13-4c4a-58df-a257-56c19e997d7f, identifier: AY74749
2026-03-28 05:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-28 05:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-28 05:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749 to the API
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:50:33Z',
 'fuel_type': 'petrol',
 'id': 'acc13f13-4c4a-58df-a257-56c19e997d7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY74749',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 180055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-14',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Maxi Kasten',
 'transmission': 'manual',
 'trim': 'Maxi Kasten',
 'year': 2013}
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Saving data for AY74749: {'auction_closing_time': 1774716633.0, 'created_time': 1774553000.231953, 'last_price_update_time': 1774676467.814052}
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY74749') HTTP/1.1" 204 0
2026-03-28 05:41:07 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN73492%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Scrape type for JN73492: 0
2026-03-28 05:41:07 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94475%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Scrape type for UY94475: 0
2026-03-28 05:41:07 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-28 05:41:07 [auto1.de] INFO: Scrape type for SX50197: 2
2026-03-28 05:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-28 05:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bef95e-a95f-540a-83f6-dd35edce1637 with scrape type 2
2026-03-28 05:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bef95e-a95f-540a-83f6-dd35edce1637 with scrape type 2
2026-03-28 05:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9bef95e-a95f-540a-83f6-dd35edce1637, identifier: SX50197
2026-03-28 05:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-28 05:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-28 05:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197 to the API
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:11:56Z',
 'fuel_type': 'petrol',
 'id': 'e9bef95e-a95f-540a-83f6-dd35edce1637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX50197',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 192978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Saving data for SX50197: {'auction_closing_time': 1774714316.0, 'created_time': 1774552635.44326, 'last_price_update_time': 1774676468.290253}
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX50197') HTTP/1.1" 204 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY42291%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for HY42291: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34180%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for WP34180: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV35876%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for VV35876: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH05548%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for EH05548: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA33739%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for UA33739: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX77489%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for FX77489: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 05:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:08 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for SB28206: 0
2026-03-28 05:41:08 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-28 05:41:08 [auto1.de] INFO: Scrape type for FK23500: 2
2026-03-28 05:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-28 05:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with scrape type 2
2026-03-28 05:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with scrape type 2
2026-03-28 05:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d, identifier: FK23500
2026-03-28 05:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-28 05:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500
2026-03-28 05:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d with identifier: FK23500 to the API
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:22:05Z',
 'fuel_type': 'diesel',
 'id': 'baaab1c4-9cc7-50dd-a7a4-fb8d77879c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK23500',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 56691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI L L3',
 'transmission': 'manual',
 'trim': 'L L3',
 'year': 2020}
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Saving data for FK23500: {'auction_closing_time': 1774714925.0, 'created_time': 1774463935.570187, 'last_price_update_time': 1774676469.341125}
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK23500') HTTP/1.1" 204 0
2026-03-28 05:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for WJ35456: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS00144%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for XS00144: 2
2026-03-28 05:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with identifier: XS00144
2026-03-28 05:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with scrape type 2
2026-03-28 05:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with scrape type 2
2026-03-28 05:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d46ae1d3-b3e0-5fb8-9588-6e332f32d34a, identifier: XS00144
2026-03-28 05:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with identifier: XS00144
2026-03-28 05:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with identifier: XS00144
2026-03-28 05:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d46ae1d3-b3e0-5fb8-9588-6e332f32d34a with identifier: XS00144 to the API
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:51:58Z',
 'fuel_type': 'petrol',
 'id': 'd46ae1d3-b3e0-5fb8-9588-6e332f32d34a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS00144',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 18802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-23',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Mild-Hybrid Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS00144%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Saving data for XS00144: {'auction_closing_time': 1774716718.0, 'created_time': 1774468276.998598, 'last_price_update_time': 1774676469.908921}
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS00144') HTTP/1.1" 204 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV97626%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for FV97626: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89703%27 HTTP/1.1" 200 None
2026-03-28 05:41:09 [auto1.de] INFO: Scrape type for LT89703: 0
2026-03-28 05:41:09 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-28 05:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82550%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for FC82550: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL59137%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for RL59137: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: MJ34390
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ34390%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for MJ34390: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00841%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for LC00841: 2
2026-03-28 05:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6c51a1-425e-5cab-8e50-286bcb50d619 with identifier: LC00841
2026-03-28 05:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6c51a1-425e-5cab-8e50-286bcb50d619 with scrape type 2
2026-03-28 05:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6c51a1-425e-5cab-8e50-286bcb50d619 with scrape type 2
2026-03-28 05:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae6c51a1-425e-5cab-8e50-286bcb50d619, identifier: LC00841
2026-03-28 05:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae6c51a1-425e-5cab-8e50-286bcb50d619 with identifier: LC00841
2026-03-28 05:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae6c51a1-425e-5cab-8e50-286bcb50d619 with identifier: LC00841
2026-03-28 05:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae6c51a1-425e-5cab-8e50-286bcb50d619 with identifier: LC00841 to the API
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:39:32Z',
 'fuel_type': 'petrol',
 'id': 'ae6c51a1-425e-5cab-8e50-286bcb50d619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC00841',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 209801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00841%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Saving data for LC00841: {'auction_closing_time': 1774715972.0, 'created_time': 1774466318.3609, 'last_price_update_time': 1774676470.570952}
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC00841') HTTP/1.1" 204 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS97225%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for DS97225: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH41234%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for MH41234: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG42574%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for AG42574: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF44435%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for SF44435: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35073%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for NC35073: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78858%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for VU78858: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB59188%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for CB59188: 0
2026-03-28 05:41:10 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM96643%27 HTTP/1.1" 200 None
2026-03-28 05:41:10 [auto1.de] INFO: Scrape type for CM96643: 2
2026-03-28 05:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c87a965-097b-5690-a66f-bee928dbac00 with identifier: CM96643
2026-03-28 05:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c87a965-097b-5690-a66f-bee928dbac00 with scrape type 2
2026-03-28 05:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c87a965-097b-5690-a66f-bee928dbac00 with scrape type 2
2026-03-28 05:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c87a965-097b-5690-a66f-bee928dbac00, identifier: CM96643
2026-03-28 05:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c87a965-097b-5690-a66f-bee928dbac00 with identifier: CM96643
2026-03-28 05:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c87a965-097b-5690-a66f-bee928dbac00 with identifier: CM96643
2026-03-28 05:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c87a965-097b-5690-a66f-bee928dbac00 with identifier: CM96643 to the API
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:28:27Z',
 'fuel_type': 'petrol',
 'id': '5c87a965-097b-5690-a66f-bee928dbac00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM96643',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 171147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM96643%27 HTTP/1.1" 200 None
2026-03-28 05:41:11 [auto1.de] INFO: Saving data for CM96643: {'auction_closing_time': 1774715307.0, 'created_time': 1773138264.079564, 'last_price_update_time': 1774676471.313166}
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM96643') HTTP/1.1" 204 0
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 05:41:11 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-28 05:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:12 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX49972%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for GX49972: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for YZ97980: 2
2026-03-28 05:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-28 05:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbc63d4-71ca-580e-98a8-b6e5f332717e with scrape type 2
2026-03-28 05:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbc63d4-71ca-580e-98a8-b6e5f332717e with scrape type 2
2026-03-28 05:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbbc63d4-71ca-580e-98a8-b6e5f332717e, identifier: YZ97980
2026-03-28 05:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-28 05:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-28 05:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980 to the API
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:49Z',
 'fuel_type': 'diesel',
 'id': 'dbbc63d4-71ca-580e-98a8-b6e5f332717e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ97980',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 64053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2020}
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Saving data for YZ97980: {'auction_closing_time': 1774716049.0, 'created_time': 1774468184.942968, 'last_price_update_time': 1774676472.728015}
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ97980') HTTP/1.1" 204 0
2026-03-28 05:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29810%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for RM29810: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN52823%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for TN52823: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09706%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for FP09706: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-28 05:41:12 [auto1.de] INFO: Scrape type for BL21282: 0
2026-03-28 05:41:12 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 05:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL92656%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for ZL92656: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for ZN73895: 2
2026-03-28 05:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-28 05:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 2
2026-03-28 05:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 2
2026-03-28 05:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf748ad-260c-52e1-afb0-701034a3a560, identifier: ZN73895
2026-03-28 05:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-28 05:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-28 05:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895 to the API
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'diesel',
 'id': 'bdf748ad-260c-52e1-afb0-701034a3a560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN73895',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 78681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Saving data for ZN73895: {'auction_closing_time': 1774716389.0, 'created_time': 1774550699.262073, 'last_price_update_time': 1774676473.467052}
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN73895') HTTP/1.1" 204 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU43780%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for BU43780: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for LN26385: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF95436%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for ZF95436: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA51828%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for HA51828: 0
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: HR47989
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 05:41:13 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH42647%27 HTTP/1.1" 200 None
2026-03-28 05:41:13 [auto1.de] INFO: Scrape type for AH42647: 2
2026-03-28 05:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 339aaded-6f5d-50cc-9aca-162bb0e9388f with identifier: AH42647
2026-03-28 05:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 339aaded-6f5d-50cc-9aca-162bb0e9388f with scrape type 2
2026-03-28 05:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 339aaded-6f5d-50cc-9aca-162bb0e9388f with scrape type 2
2026-03-28 05:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 339aaded-6f5d-50cc-9aca-162bb0e9388f, identifier: AH42647
2026-03-28 05:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 339aaded-6f5d-50cc-9aca-162bb0e9388f with identifier: AH42647
2026-03-28 05:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 339aaded-6f5d-50cc-9aca-162bb0e9388f with identifier: AH42647
2026-03-28 05:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 339aaded-6f5d-50cc-9aca-162bb0e9388f with identifier: AH42647 to the API
2026-03-28 05:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:22:55Z',
 'fuel_type': 'petrol',
 'id': '339aaded-6f5d-50cc-9aca-162bb0e9388f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH42647',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 37486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-30',
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2022}
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH42647%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Saving data for AH42647: {'auction_closing_time': 1774714975.0, 'created_time': 1774468209.221528, 'last_price_update_time': 1774676474.124059}
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH42647') HTTP/1.1" 204 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96122%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for FH96122: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC73620%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for RC73620: 0
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-28 05:41:14 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH14948%27 HTTP/1.1" 200 None
2026-03-28 05:41:14 [auto1.de] INFO: Scrape type for YH14948: 0
2026-03-28 05:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:15 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for VW77341: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for GA97720: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC36947%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for LC36947: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for NP46589: 0
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10320%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for AK10320: 2
2026-03-28 05:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142dad11-400e-59f3-a83d-d4bcb4f29105 with identifier: AK10320
2026-03-28 05:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142dad11-400e-59f3-a83d-d4bcb4f29105 with scrape type 2
2026-03-28 05:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142dad11-400e-59f3-a83d-d4bcb4f29105 with scrape type 2
2026-03-28 05:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142dad11-400e-59f3-a83d-d4bcb4f29105, identifier: AK10320
2026-03-28 05:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142dad11-400e-59f3-a83d-d4bcb4f29105 with identifier: AK10320
2026-03-28 05:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142dad11-400e-59f3-a83d-d4bcb4f29105 with identifier: AK10320
2026-03-28 05:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142dad11-400e-59f3-a83d-d4bcb4f29105 with identifier: AK10320 to the API
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:09:29Z',
 'fuel_type': 'diesel',
 'id': '142dad11-400e-59f3-a83d-d4bcb4f29105',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK10320',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 193659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-05',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10320%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Saving data for AK10320: {'auction_closing_time': 1774714169.0, 'created_time': 1774468117.368434, 'last_price_update_time': 1774676475.730173}
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK10320') HTTP/1.1" 204 0
2026-03-28 05:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-28 05:41:15 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ88481%27 HTTP/1.1" 200 None
2026-03-28 05:41:15 [auto1.de] INFO: Scrape type for AZ88481: 2
2026-03-28 05:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with identifier: AZ88481
2026-03-28 05:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with scrape type 2
2026-03-28 05:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with scrape type 2
2026-03-28 05:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd, identifier: AZ88481
2026-03-28 05:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with identifier: AZ88481
2026-03-28 05:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with identifier: AZ88481
2026-03-28 05:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd with identifier: AZ88481 to the API
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:59Z',
 'fuel_type': 'diesel',
 'id': '0fabb4e6-8db5-5f2d-b1df-eec9ba84d0cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ88481',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 143038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ88481%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Saving data for AZ88481: {'auction_closing_time': 1774713659.0, 'created_time': 1774467817.840769, 'last_price_update_time': 1774676476.266382}
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ88481') HTTP/1.1" 204 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ65232%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for UJ65232: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV48088%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for DV48088: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW61921%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for NW61921: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP60462%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for YP60462: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW72193%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for XW72193: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for JR17394: 2
2026-03-28 05:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-28 05:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82857689-10ce-5d56-9709-ea1a81e1726e with scrape type 2
2026-03-28 05:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82857689-10ce-5d56-9709-ea1a81e1726e with scrape type 2
2026-03-28 05:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82857689-10ce-5d56-9709-ea1a81e1726e, identifier: JR17394
2026-03-28 05:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-28 05:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-28 05:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394 to the API
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:05:43Z',
 'fuel_type': 'diesel',
 'id': '82857689-10ce-5d56-9709-ea1a81e1726e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17394',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 147814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Saving data for JR17394: {'auction_closing_time': 1774713943.0, 'created_time': 1774552779.072235, 'last_price_update_time': 1774676476.867613}
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR17394') HTTP/1.1" 204 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-28 05:41:16 [auto1.de] INFO: Scrape type for FP18966: 0
2026-03-28 05:41:16 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-28 05:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for CS08298: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for MD58686: 2
2026-03-28 05:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-28 05:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd95a08a-220e-5cc1-95ae-6836fa0149f6 with scrape type 2
2026-03-28 05:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd95a08a-220e-5cc1-95ae-6836fa0149f6 with scrape type 2
2026-03-28 05:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd95a08a-220e-5cc1-95ae-6836fa0149f6, identifier: MD58686
2026-03-28 05:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-28 05:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-28 05:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686 to the API
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:03:20Z',
 'fuel_type': 'petrol',
 'id': 'cd95a08a-220e-5cc1-95ae-6836fa0149f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD58686',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 170641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 5 Star Edition 2WD',
 'transmission': 'manual',
 'trim': '5 Star Edition 2WD',
 'year': 2013}
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Saving data for MD58686: {'auction_closing_time': 1774713800.0, 'created_time': 1774552706.872112, 'last_price_update_time': 1774676477.41976}
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD58686') HTTP/1.1" 204 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT60437%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for RT60437: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS72230%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for SS72230: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW71127%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for AW71127: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN04520%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for BN04520: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH76596%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for KH76596: 0
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-28 05:41:17 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Scrape type for GV12841: 2
2026-03-28 05:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-28 05:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 323c9358-fa13-5594-82e4-3787ff0bfce1 with scrape type 2
2026-03-28 05:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 323c9358-fa13-5594-82e4-3787ff0bfce1 with scrape type 2
2026-03-28 05:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 323c9358-fa13-5594-82e4-3787ff0bfce1, identifier: GV12841
2026-03-28 05:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-28 05:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-28 05:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841 to the API
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:24Z',
 'fuel_type': 'diesel',
 'id': '323c9358-fa13-5594-82e4-3787ff0bfce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV12841',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-28 05:41:17 [auto1.de] INFO: Saving data for GV12841: {'auction_closing_time': 1774717164.0, 'created_time': 1774552979.809654, 'last_price_update_time': 1774676477.991109}
2026-03-28 05:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV12841') HTTP/1.1" 204 0
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-28 05:41:18 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-28 05:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:19 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE13934%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for EE13934: 0
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for UR30493: 2
2026-03-28 05:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-28 05:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with scrape type 2
2026-03-28 05:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with scrape type 2
2026-03-28 05:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d42c80c-8f1d-5e61-aa50-545713ace3d5, identifier: UR30493
2026-03-28 05:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-28 05:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-28 05:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493 to the API
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:57:22Z',
 'fuel_type': 'diesel',
 'id': '9d42c80c-8f1d-5e61-aa50-545713ace3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR30493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 37537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-09',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Saving data for UR30493: {'auction_closing_time': 1774717042.0, 'created_time': 1773138482.550801, 'last_price_update_time': 1774676479.523993}
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR30493') HTTP/1.1" 204 0
2026-03-28 05:41:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 05:41:19 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-28 05:41:19 [auto1.de] INFO: Scrape type for KU99299: 2
2026-03-28 05:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-28 05:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with scrape type 2
2026-03-28 05:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with scrape type 2
2026-03-28 05:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855, identifier: KU99299
2026-03-28 05:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-28 05:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-28 05:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299 to the API
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:28:55Z',
 'fuel_type': 'petrol',
 'id': '9c1be5e2-c1bc-56d5-b46f-7500f2fcb855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU99299',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 128914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 350 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Saving data for KU99299: {'auction_closing_time': 1774715335.0, 'created_time': 1774552747.337017, 'last_price_update_time': 1774676480.011401}
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU99299') HTTP/1.1" 204 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE34583%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for TE34583: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for KC01296: 2
2026-03-28 05:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-28 05:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580fe904-cb17-5aa3-b76b-7ef52080d20c with scrape type 2
2026-03-28 05:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580fe904-cb17-5aa3-b76b-7ef52080d20c with scrape type 2
2026-03-28 05:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 580fe904-cb17-5aa3-b76b-7ef52080d20c, identifier: KC01296
2026-03-28 05:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-28 05:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-28 05:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296 to the API
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:31:59Z',
 'fuel_type': 'diesel',
 'id': '580fe904-cb17-5aa3-b76b-7ef52080d20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC01296',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 130218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-07',
 'seller_name': None,
 'title': 'Audi Q7 4.2 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Saving data for KC01296: {'auction_closing_time': 1774715519.0, 'created_time': 1774552929.540645, 'last_price_update_time': 1774676480.467657}
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC01296') HTTP/1.1" 204 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC48203%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for YC48203: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: XH77572
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH77572%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for XH77572: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT62764%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for FT62764: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for MM26865: 0
2026-03-28 05:41:20 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY02609%27 HTTP/1.1" 200 None
2026-03-28 05:41:20 [auto1.de] INFO: Scrape type for MY02609: 2
2026-03-28 05:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1e11e34-8428-515c-9207-036519185387 with identifier: MY02609
2026-03-28 05:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1e11e34-8428-515c-9207-036519185387 with scrape type 2
2026-03-28 05:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1e11e34-8428-515c-9207-036519185387 with scrape type 2
2026-03-28 05:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1e11e34-8428-515c-9207-036519185387, identifier: MY02609
2026-03-28 05:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1e11e34-8428-515c-9207-036519185387 with identifier: MY02609
2026-03-28 05:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1e11e34-8428-515c-9207-036519185387 with identifier: MY02609
2026-03-28 05:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1e11e34-8428-515c-9207-036519185387 with identifier: MY02609 to the API
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:19:45Z',
 'fuel_type': 'diesel',
 'id': 'd1e11e34-8428-515c-9207-036519185387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY02609',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 226397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-20',
 'seller_name': None,
 'title': 'Audi A4 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY02609%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Saving data for MY02609: {'auction_closing_time': 1774714785.0, 'created_time': 1774464080.145697, 'last_price_update_time': 1774676481.10324}
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY02609') HTTP/1.1" 204 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: CY63402
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY63402%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for CY63402: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94597%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for FG94597: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY68154%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for CY68154: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for TE07006: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL38962%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for FL38962: 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK46666%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Scrape type for EK46666: 2
2026-03-28 05:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with identifier: EK46666
2026-03-28 05:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with scrape type 2
2026-03-28 05:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with scrape type 2
2026-03-28 05:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b17d02a-c0eb-5131-bf30-e2544ff83c74, identifier: EK46666
2026-03-28 05:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with identifier: EK46666
2026-03-28 05:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with identifier: EK46666
2026-03-28 05:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b17d02a-c0eb-5131-bf30-e2544ff83c74 with identifier: EK46666 to the API
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:16:08Z',
 'fuel_type': 'petrol',
 'id': '2b17d02a-c0eb-5131-bf30-e2544ff83c74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK46666',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 144643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2001}
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK46666%27 HTTP/1.1" 200 None
2026-03-28 05:41:21 [auto1.de] INFO: Saving data for EK46666: {'auction_closing_time': 1774714568.0, 'created_time': 1774467711.461959, 'last_price_update_time': 1774676481.851311}
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK46666') HTTP/1.1" 204 0
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-28 05:41:21 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 05:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:23 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU45291%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for RU45291: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for SG68469: 2
2026-03-28 05:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-28 05:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae7375a-3a06-5815-b8ee-a41071a75e9c with scrape type 2
2026-03-28 05:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae7375a-3a06-5815-b8ee-a41071a75e9c with scrape type 2
2026-03-28 05:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ae7375a-3a06-5815-b8ee-a41071a75e9c, identifier: SG68469
2026-03-28 05:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-28 05:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-28 05:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469 to the API
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:16:42Z',
 'fuel_type': 'diesel',
 'id': '8ae7375a-3a06-5815-b8ee-a41071a75e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG68469',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 239220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency',
 'year': 2010}
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Saving data for SG68469: {'auction_closing_time': 1774714602.0, 'created_time': 1774552921.087814, 'last_price_update_time': 1774676483.760108}
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG68469') HTTP/1.1" 204 0
2026-03-28 05:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT67074%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for ZT67074: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for PU90892: 0
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-28 05:41:23 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-28 05:41:23 [auto1.de] INFO: Scrape type for GJ75374: 2
2026-03-28 05:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-28 05:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with scrape type 2
2026-03-28 05:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with scrape type 2
2026-03-28 05:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8, identifier: GJ75374
2026-03-28 05:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-28 05:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-28 05:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374 to the API
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '50c42aa6-351b-53a2-b1c4-a3c21a61bdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ75374',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 93868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-03',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Saving data for GJ75374: {'auction_closing_time': 1774716173.0, 'created_time': 1774553021.008624, 'last_price_update_time': 1774676484.215729}
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ75374') HTTP/1.1" 204 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: XP12912
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP12912%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for XP12912: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK88346%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for KK88346: 2
2026-03-28 05:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16346615-e4ed-596c-9d0f-d41142d4be73 with identifier: KK88346
2026-03-28 05:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16346615-e4ed-596c-9d0f-d41142d4be73 with scrape type 2
2026-03-28 05:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16346615-e4ed-596c-9d0f-d41142d4be73 with scrape type 2
2026-03-28 05:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16346615-e4ed-596c-9d0f-d41142d4be73, identifier: KK88346
2026-03-28 05:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16346615-e4ed-596c-9d0f-d41142d4be73 with identifier: KK88346
2026-03-28 05:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16346615-e4ed-596c-9d0f-d41142d4be73 with identifier: KK88346
2026-03-28 05:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16346615-e4ed-596c-9d0f-d41142d4be73 with identifier: KK88346 to the API
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:40Z',
 'fuel_type': 'petrol',
 'id': '16346615-e4ed-596c-9d0f-d41142d4be73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK88346',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 130115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK88346%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Saving data for KK88346: {'auction_closing_time': 1774715080.0, 'created_time': 1774553113.476563, 'last_price_update_time': 1774676484.837411}
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK88346') HTTP/1.1" 204 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP11073%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for XP11073: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN09383%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for ZN09383: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77411%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for VX77411: 0
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-28 05:41:24 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-28 05:41:24 [auto1.de] INFO: Scrape type for CD05825: 2
2026-03-28 05:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-28 05:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82385f4a-a469-54cf-871c-94cd190d0b3d with scrape type 2
2026-03-28 05:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82385f4a-a469-54cf-871c-94cd190d0b3d with scrape type 2
2026-03-28 05:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82385f4a-a469-54cf-871c-94cd190d0b3d, identifier: CD05825
2026-03-28 05:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-28 05:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-28 05:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825 to the API
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'diesel',
 'id': '82385f4a-a469-54cf-871c-94cd190d0b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD05825',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 166873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Saving data for CD05825: {'auction_closing_time': 1774716807.0, 'created_time': 1774552880.470542, 'last_price_update_time': 1774676485.336921}
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD05825') HTTP/1.1" 204 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for VY22593: 2
2026-03-28 05:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-28 05:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with scrape type 2
2026-03-28 05:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with scrape type 2
2026-03-28 05:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5, identifier: VY22593
2026-03-28 05:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-28 05:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-28 05:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593 to the API
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:30:02Z',
 'fuel_type': 'petrol',
 'id': '708702a3-c4b3-5990-ba1f-c7e1ba6827a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY22593',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 104507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Saving data for VY22593: {'auction_closing_time': 1774715402.0, 'created_time': 1774552729.226329, 'last_price_update_time': 1774676485.897026}
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY22593') HTTP/1.1" 204 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS98527%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for ZS98527: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47002%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for EN47002: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE90038%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for RE90038: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-28 05:41:25 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-28 05:41:25 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC66618%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for PC66618: 0
2026-03-28 05:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:26 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP79611%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for VP79611: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR43035%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for LR43035: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88133%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for JZ88133: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB28652%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for ZB28652: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL11639%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for HL11639: 0
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-28 05:41:26 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89558%27 HTTP/1.1" 200 None
2026-03-28 05:41:26 [auto1.de] INFO: Scrape type for SS89558: 2
2026-03-28 05:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with identifier: SS89558
2026-03-28 05:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with scrape type 2
2026-03-28 05:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with scrape type 2
2026-03-28 05:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1742f22-ebe9-5cf0-9cff-19908d9c9f16, identifier: SS89558
2026-03-28 05:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with identifier: SS89558
2026-03-28 05:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with identifier: SS89558
2026-03-28 05:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1742f22-ebe9-5cf0-9cff-19908d9c9f16 with identifier: SS89558 to the API
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:15:48Z',
 'fuel_type': 'petrol',
 'id': 'd1742f22-ebe9-5cf0-9cff-19908d9c9f16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS89558',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 109151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89558%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Saving data for SS89558: {'auction_closing_time': 1774714548.0, 'created_time': 1774035485.890071, 'last_price_update_time': 1774676487.320616}
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS89558') HTTP/1.1" 204 0
2026-03-28 05:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: VA48219
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA48219%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for VA48219: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16852%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for MH16852: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66299%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for HS66299: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30445%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for XH30445: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ39888%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for ZZ39888: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP83508%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for DP83508: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE14755%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for JE14755: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN43654%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for XN43654: 0
2026-03-28 05:41:27 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-28 05:41:27 [auto1.de] INFO: Scrape type for XE32981: 2
2026-03-28 05:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-28 05:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7c04a6-8053-51a8-9b23-67116aa1d93c with scrape type 2
2026-03-28 05:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d7c04a6-8053-51a8-9b23-67116aa1d93c with scrape type 2
2026-03-28 05:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d7c04a6-8053-51a8-9b23-67116aa1d93c, identifier: XE32981
2026-03-28 05:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-28 05:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-28 05:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981 to the API
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:27:20Z',
 'fuel_type': 'petrol',
 'id': '7d7c04a6-8053-51a8-9b23-67116aa1d93c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE32981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 177819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2009}
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Saving data for XE32981: {'auction_closing_time': 1774715240.0, 'created_time': 1774551110.859424, 'last_price_update_time': 1774676488.041928}
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE32981') HTTP/1.1" 204 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU00171%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for RU00171: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB69161%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for FB69161: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90815%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for XB90815: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 05:41:28 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG11664%27 HTTP/1.1" 200 None
2026-03-28 05:41:28 [auto1.de] INFO: Scrape type for MG11664: 0
2026-03-28 05:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:29 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for JL52757: 0
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for MH48828: 2
2026-03-28 05:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-28 05:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3923e807-192a-5292-bca9-26ef1f323668 with scrape type 2
2026-03-28 05:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3923e807-192a-5292-bca9-26ef1f323668 with scrape type 2
2026-03-28 05:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3923e807-192a-5292-bca9-26ef1f323668, identifier: MH48828
2026-03-28 05:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-28 05:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-28 05:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828 to the API
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:02:37Z',
 'fuel_type': 'petrol',
 'id': '3923e807-192a-5292-bca9-26ef1f323668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH48828',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 106061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Saving data for MH48828: {'auction_closing_time': 1774713757.0, 'created_time': 1774553139.634284, 'last_price_update_time': 1774676489.751139}
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH48828') HTTP/1.1" 204 0
2026-03-28 05:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ91019%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for RJ91019: 0
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW48345%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for NW48345: 0
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC77808%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for CC77808: 0
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for CC84922: 0
2026-03-28 05:41:29 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-28 05:41:29 [auto1.de] INFO: Scrape type for RS45157: 2
2026-03-28 05:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-28 05:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with scrape type 2
2026-03-28 05:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with scrape type 2
2026-03-28 05:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b, identifier: RS45157
2026-03-28 05:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-28 05:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-28 05:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157 to the API
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:26:08Z',
 'fuel_type': 'diesel',
 'id': 'cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45157',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 146747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Saving data for RS45157: {'auction_closing_time': 1774715168.0, 'created_time': 1773403202.361555, 'last_price_update_time': 1774676490.409888}
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS45157') HTTP/1.1" 204 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55645%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for HT55645: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ17702%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for TJ17702: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: WX42639
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX42639%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for WX42639: 0
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-28 05:41:30 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Scrape type for BX62437: 2
2026-03-28 05:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-28 05:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb52abd3-624d-5bcf-bc7a-96e781df2035 with scrape type 2
2026-03-28 05:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb52abd3-624d-5bcf-bc7a-96e781df2035 with scrape type 2
2026-03-28 05:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb52abd3-624d-5bcf-bc7a-96e781df2035, identifier: BX62437
2026-03-28 05:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-28 05:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-28 05:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437 to the API
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:29Z',
 'fuel_type': 'diesel',
 'id': 'cb52abd3-624d-5bcf-bc7a-96e781df2035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX62437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 345146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-28 05:41:30 [auto1.de] INFO: Saving data for BX62437: {'auction_closing_time': 1774715909.0, 'created_time': 1774552727.954053, 'last_price_update_time': 1774676490.930689}
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX62437') HTTP/1.1" 204 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for FG01299: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-28 05:41:31 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-28 05:41:31 [auto1.de] INFO: Scrape type for FE62159: 2
2026-03-28 05:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-28 05:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83495658-c211-5d79-9905-2878eb47eacc with scrape type 2
2026-03-28 05:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83495658-c211-5d79-9905-2878eb47eacc with scrape type 2
2026-03-28 05:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83495658-c211-5d79-9905-2878eb47eacc, identifier: FE62159
2026-03-28 05:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-28 05:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-28 05:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159 to the API
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:43:38Z',
 'fuel_type': 'petrol',
 'id': '83495658-c211-5d79-9905-2878eb47eacc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE62159',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 36662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Saving data for FE62159: {'auction_closing_time': 1774716218.0, 'created_time': 1774553149.868523, 'last_price_update_time': 1774676492.292175}
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE62159') HTTP/1.1" 204 0
2026-03-28 05:41:32 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ20082%27 HTTP/1.1" 200 None
2026-03-28 05:41:32 [auto1.de] INFO: Scrape type for XZ20082: 2
2026-03-28 05:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7005cf27-9777-5f68-9a35-8def8331c1c3 with identifier: XZ20082
2026-03-28 05:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7005cf27-9777-5f68-9a35-8def8331c1c3 with scrape type 2
2026-03-28 05:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7005cf27-9777-5f68-9a35-8def8331c1c3 with scrape type 2
2026-03-28 05:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7005cf27-9777-5f68-9a35-8def8331c1c3, identifier: XZ20082
2026-03-28 05:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7005cf27-9777-5f68-9a35-8def8331c1c3 with identifier: XZ20082
2026-03-28 05:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7005cf27-9777-5f68-9a35-8def8331c1c3 with identifier: XZ20082
2026-03-28 05:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7005cf27-9777-5f68-9a35-8def8331c1c3 with identifier: XZ20082 to the API
2026-03-28 05:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:34Z',
 'fuel_type': 'diesel',
 'id': '7005cf27-9777-5f68-9a35-8def8331c1c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ20082',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 169406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Nakama 2WD',
 'transmission': 'manual',
 'trim': 'Nakama 2WD',
 'year': 2017}
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ20082%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Saving data for XZ20082: {'auction_closing_time': 1774713814.0, 'created_time': 1774468129.077061, 'last_price_update_time': 1774676493.284638}
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ20082') HTTP/1.1" 204 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ20598%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for AZ20598: 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK12624%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for PK12624: 2
2026-03-28 05:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8107e98-f00a-50c9-8d01-b1c66a4ff779 with identifier: PK12624
2026-03-28 05:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8107e98-f00a-50c9-8d01-b1c66a4ff779 with scrape type 2
2026-03-28 05:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8107e98-f00a-50c9-8d01-b1c66a4ff779 with scrape type 2
2026-03-28 05:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8107e98-f00a-50c9-8d01-b1c66a4ff779, identifier: PK12624
2026-03-28 05:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8107e98-f00a-50c9-8d01-b1c66a4ff779 with identifier: PK12624
2026-03-28 05:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8107e98-f00a-50c9-8d01-b1c66a4ff779 with identifier: PK12624
2026-03-28 05:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8107e98-f00a-50c9-8d01-b1c66a4ff779 with identifier: PK12624 to the API
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:50:38Z',
 'fuel_type': 'petrol',
 'id': 'c8107e98-f00a-50c9-8d01-b1c66a4ff779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK12624',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 58180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2017}
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK12624%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Saving data for PK12624: {'auction_closing_time': 1774716638.0, 'created_time': 1774463896.906854, 'last_price_update_time': 1774676493.758485}
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK12624') HTTP/1.1" 204 0
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 05:41:33 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-28 05:41:33 [auto1.de] INFO: Scrape type for DE54360: 2
2026-03-28 05:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-28 05:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6058083a-4357-56d4-918c-384c56dbe5a7 with scrape type 2
2026-03-28 05:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6058083a-4357-56d4-918c-384c56dbe5a7 with scrape type 2
2026-03-28 05:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6058083a-4357-56d4-918c-384c56dbe5a7, identifier: DE54360
2026-03-28 05:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-28 05:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-28 05:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360 to the API
2026-03-28 05:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:38Z',
 'fuel_type': 'diesel',
 'id': '6058083a-4357-56d4-918c-384c56dbe5a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE54360',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Saving data for DE54360: {'auction_closing_time': 1774715138.0, 'created_time': 1774552146.76545, 'last_price_update_time': 1774676494.248108}
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE54360') HTTP/1.1" 204 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64349%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for NU64349: 2
2026-03-28 05:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with identifier: NU64349
2026-03-28 05:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with scrape type 2
2026-03-28 05:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with scrape type 2
2026-03-28 05:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da8150e7-d8ac-5b94-b239-3da0ccfdc2c4, identifier: NU64349
2026-03-28 05:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with identifier: NU64349
2026-03-28 05:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with identifier: NU64349
2026-03-28 05:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da8150e7-d8ac-5b94-b239-3da0ccfdc2c4 with identifier: NU64349 to the API
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:31Z',
 'fuel_type': 'petrol',
 'id': 'da8150e7-d8ac-5b94-b239-3da0ccfdc2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU64349',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 196046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-15',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64349%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Saving data for NU64349: {'auction_closing_time': 1774715731.0, 'created_time': 1774551212.37484, 'last_price_update_time': 1774676494.845295}
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU64349') HTTP/1.1" 204 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM08251%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for VM08251: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for BF92726: 0
2026-03-28 05:41:34 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-28 05:41:34 [auto1.de] INFO: Scrape type for SV97177: 0
2026-03-28 05:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:35 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS85848%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for LS85848: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA92552%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for MA92552: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP06272%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for WP06272: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV65753%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for NV65753: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: US20964
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for US20964: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19637%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for YP19637: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for UC67587: 2
2026-03-28 05:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-28 05:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd897983-c80e-5b75-b1a7-235a8388560b with scrape type 2
2026-03-28 05:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd897983-c80e-5b75-b1a7-235a8388560b with scrape type 2
2026-03-28 05:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd897983-c80e-5b75-b1a7-235a8388560b, identifier: UC67587
2026-03-28 05:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-28 05:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587
2026-03-28 05:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd897983-c80e-5b75-b1a7-235a8388560b with identifier: UC67587 to the API
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:10:40Z',
 'fuel_type': 'petrol',
 'id': 'bd897983-c80e-5b75-b1a7-235a8388560b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC67587',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 132972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-03',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2011}
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Saving data for UC67587: {'auction_closing_time': 1774714240.0, 'created_time': 1774463862.410407, 'last_price_update_time': 1774676495.567761}
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC67587') HTTP/1.1" 204 0
2026-03-28 05:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for JB33429: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE38755%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for JE38755: 0
2026-03-28 05:41:35 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-28 05:41:35 [auto1.de] INFO: Scrape type for KH41700: 2
2026-03-28 05:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-28 05:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807c6e26-7af2-5b94-8acc-97ef0e448a76 with scrape type 2
2026-03-28 05:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807c6e26-7af2-5b94-8acc-97ef0e448a76 with scrape type 2
2026-03-28 05:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 807c6e26-7af2-5b94-8acc-97ef0e448a76, identifier: KH41700
2026-03-28 05:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-28 05:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-28 05:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700 to the API
2026-03-28 05:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:14:52Z',
 'fuel_type': 'petrol',
 'id': '807c6e26-7af2-5b94-8acc-97ef0e448a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH41700',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 35310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2020}
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Saving data for KH41700: {'auction_closing_time': 1774714492.0, 'created_time': 1774552990.2077, 'last_price_update_time': 1774676496.131176}
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH41700') HTTP/1.1" 204 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for KM43405: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for EC14916: 2
2026-03-28 05:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-28 05:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92558692-110c-551f-aa31-0fc434be3108 with scrape type 2
2026-03-28 05:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92558692-110c-551f-aa31-0fc434be3108 with scrape type 2
2026-03-28 05:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92558692-110c-551f-aa31-0fc434be3108, identifier: EC14916
2026-03-28 05:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-28 05:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-28 05:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916 to the API
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:50Z',
 'fuel_type': 'petrol',
 'id': '92558692-110c-551f-aa31-0fc434be3108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC14916',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 139027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Suzuki Swift 1.0 BoosterJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Saving data for EC14916: {'auction_closing_time': 1774715090.0, 'created_time': 1774552016.059288, 'last_price_update_time': 1774676496.619644}
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC14916') HTTP/1.1" 204 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73994%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for BK73994: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW66506%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for CW66506: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-28 05:41:36 [auto1.de] INFO: Scrape type for LG97713: 0
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-28 05:41:36 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 05:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:37 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for XP46424: 0
2026-03-28 05:41:37 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-28 05:41:37 [auto1.de] INFO: Scrape type for FM24732: 2
2026-03-28 05:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-28 05:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with scrape type 2
2026-03-28 05:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with scrape type 2
2026-03-28 05:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a219b7-ca9b-5483-bc59-e2600e6e04b1, identifier: FM24732
2026-03-28 05:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-28 05:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-28 05:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732 to the API
2026-03-28 05:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:12:18Z',
 'fuel_type': 'petrol',
 'id': '92a219b7-ca9b-5483-bc59-e2600e6e04b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM24732',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 41794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-28 05:41:38 [auto1.de] INFO: Saving data for FM24732: {'auction_closing_time': 1774714338.0, 'created_time': 1774552895.318305, 'last_price_update_time': 1774676498.714966}
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM24732') HTTP/1.1" 204 0
2026-03-28 05:41:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:38 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67308%27 HTTP/1.1" 200 None
2026-03-28 05:41:38 [auto1.de] INFO: Scrape type for UC67308: 2
2026-03-28 05:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c0f6a2-df87-5518-82cf-dd34541a5a89 with identifier: UC67308
2026-03-28 05:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c0f6a2-df87-5518-82cf-dd34541a5a89 with scrape type 2
2026-03-28 05:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c0f6a2-df87-5518-82cf-dd34541a5a89 with scrape type 2
2026-03-28 05:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0c0f6a2-df87-5518-82cf-dd34541a5a89, identifier: UC67308
2026-03-28 05:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0c0f6a2-df87-5518-82cf-dd34541a5a89 with identifier: UC67308
2026-03-28 05:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0c0f6a2-df87-5518-82cf-dd34541a5a89 with identifier: UC67308
2026-03-28 05:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0c0f6a2-df87-5518-82cf-dd34541a5a89 with identifier: UC67308 to the API
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:21Z',
 'fuel_type': 'diesel',
 'id': 'd0c0f6a2-df87-5518-82cf-dd34541a5a89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC67308',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 236100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-07',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67308%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Saving data for UC67308: {'auction_closing_time': 1774714761.0, 'created_time': 1774466746.448546, 'last_price_update_time': 1774676499.316303}
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC67308') HTTP/1.1" 204 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for LB09285: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74325%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for RE74325: 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for CS13699: 2
2026-03-28 05:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-28 05:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457fa1af-7c05-540b-bffd-754326c33e6f with scrape type 2
2026-03-28 05:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 457fa1af-7c05-540b-bffd-754326c33e6f with scrape type 2
2026-03-28 05:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 457fa1af-7c05-540b-bffd-754326c33e6f, identifier: CS13699
2026-03-28 05:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-28 05:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-28 05:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699 to the API
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'diesel',
 'id': '457fa1af-7c05-540b-bffd-754326c33e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS13699',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 148795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Edition-S',
 'transmission': 'manual',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Saving data for CS13699: {'auction_closing_time': 1774715251.0, 'created_time': 1774551720.343787, 'last_price_update_time': 1774676499.840122}
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS13699') HTTP/1.1" 204 0
2026-03-28 05:41:39 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC78646%27 HTTP/1.1" 200 None
2026-03-28 05:41:39 [auto1.de] INFO: Scrape type for AC78646: 2
2026-03-28 05:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b14dbd40-25b3-5e73-9c91-0aee662d0f12 with identifier: AC78646
2026-03-28 05:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b14dbd40-25b3-5e73-9c91-0aee662d0f12 with scrape type 2
2026-03-28 05:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b14dbd40-25b3-5e73-9c91-0aee662d0f12 with scrape type 2
2026-03-28 05:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b14dbd40-25b3-5e73-9c91-0aee662d0f12, identifier: AC78646
2026-03-28 05:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b14dbd40-25b3-5e73-9c91-0aee662d0f12 with identifier: AC78646
2026-03-28 05:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b14dbd40-25b3-5e73-9c91-0aee662d0f12 with identifier: AC78646
2026-03-28 05:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b14dbd40-25b3-5e73-9c91-0aee662d0f12 with identifier: AC78646 to the API
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:08Z',
 'fuel_type': 'diesel',
 'id': 'b14dbd40-25b3-5e73-9c91-0aee662d0f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC78646',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 152913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC78646%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Saving data for AC78646: {'auction_closing_time': 1774713728.0, 'created_time': 1774467713.447877, 'last_price_update_time': 1774676500.286241}
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC78646') HTTP/1.1" 204 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS17715%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for LS17715: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for AZ58179: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for HH97697: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for UY74953: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for JZ29670: 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for GS82653: 2
2026-03-28 05:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-28 05:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with scrape type 2
2026-03-28 05:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with scrape type 2
2026-03-28 05:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6ed9f36-e9f6-5136-b603-bde1a0bc9341, identifier: GS82653
2026-03-28 05:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-28 05:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-28 05:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653 to the API
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'diesel',
 'id': 'f6ed9f36-e9f6-5136-b603-bde1a0bc9341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS82653',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 283269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Saving data for GS82653: {'auction_closing_time': 1774713885.0, 'created_time': 1774551553.695883, 'last_price_update_time': 1774676500.813272}
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS82653') HTTP/1.1" 204 0
2026-03-28 05:41:40 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-28 05:41:40 [auto1.de] INFO: Scrape type for PE27175: 2
2026-03-28 05:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-28 05:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with scrape type 2
2026-03-28 05:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with scrape type 2
2026-03-28 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9, identifier: PE27175
2026-03-28 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-28 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-28 05:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175 to the API
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:44Z',
 'fuel_type': 'petrol',
 'id': '7e828bf2-af05-5b37-9cfa-6052d5a0b2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE27175',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 122502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo Rocks S',
 'transmission': 'manual',
 'trim': 'Rocks S',
 'year': 2018}
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-28 05:41:41 [auto1.de] INFO: Saving data for PE27175: {'auction_closing_time': 1774717064.0, 'created_time': 1774551625.868936, 'last_price_update_time': 1774676501.335669}
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE27175') HTTP/1.1" 204 0
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-28 05:41:41 [auto1.de] INFO: Scrape type for AZ40865: 2
2026-03-28 05:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-28 05:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c415e5b8-2858-5d50-96d3-8a63713106b3 with scrape type 2
2026-03-28 05:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c415e5b8-2858-5d50-96d3-8a63713106b3 with scrape type 2
2026-03-28 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c415e5b8-2858-5d50-96d3-8a63713106b3, identifier: AZ40865
2026-03-28 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-28 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-28 05:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865 to the API
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:53:14Z',
 'fuel_type': 'petrol',
 'id': 'c415e5b8-2858-5d50-96d3-8a63713106b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ40865',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 172768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-28 05:41:41 [auto1.de] INFO: Saving data for AZ40865: {'auction_closing_time': 1774716794.0, 'created_time': 1774552946.378104, 'last_price_update_time': 1774676501.763922}
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ40865') HTTP/1.1" 204 0
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 05:41:41 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-28 05:41:41 [auto1.de] INFO: Scrape type for RY54075: 2
2026-03-28 05:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-28 05:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa03bf37-1c83-58ed-b119-235359fdf8e9 with scrape type 2
2026-03-28 05:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa03bf37-1c83-58ed-b119-235359fdf8e9 with scrape type 2
2026-03-28 05:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa03bf37-1c83-58ed-b119-235359fdf8e9, identifier: RY54075
2026-03-28 05:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-28 05:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-28 05:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075 to the API
2026-03-28 05:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'diesel',
 'id': 'aa03bf37-1c83-58ed-b119-235359fdf8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY54075',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 83812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Saving data for RY54075: {'auction_closing_time': 1774715067.0, 'created_time': 1774552711.715089, 'last_price_update_time': 1774676502.206821}
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY54075') HTTP/1.1" 204 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49243%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for ZX49243: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34728%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for SH34728: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ88186%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for SZ88186: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL39221%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for DL39221: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS00302%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for RS00302: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for VV79476: 2
2026-03-28 05:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-28 05:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac04d2b7-6325-541f-a349-ba7842918c42 with scrape type 2
2026-03-28 05:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac04d2b7-6325-541f-a349-ba7842918c42 with scrape type 2
2026-03-28 05:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac04d2b7-6325-541f-a349-ba7842918c42, identifier: VV79476
2026-03-28 05:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-28 05:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-28 05:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476 to the API
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:29:09Z',
 'fuel_type': 'petrol',
 'id': 'ac04d2b7-6325-541f-a349-ba7842918c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV79476',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 188529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-29',
 'seller_name': None,
 'title': 'Ford Focus 2.5 ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2009}
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Saving data for VV79476: {'auction_closing_time': 1774715349.0, 'created_time': 1774553176.319161, 'last_price_update_time': 1774676502.728059}
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV79476') HTTP/1.1" 204 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN68550%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for DN68550: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC69057%27 HTTP/1.1" 200 None
2026-03-28 05:41:42 [auto1.de] INFO: Scrape type for SC69057: 0
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-28 05:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:42 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 05:41:42 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-28 05:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX20102%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for HX20102: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS81640%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for LS81640: 2
2026-03-28 05:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 786a4281-6c4f-511b-99d5-c9e48f59eb74 with identifier: LS81640
2026-03-28 05:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 786a4281-6c4f-511b-99d5-c9e48f59eb74 with scrape type 2
2026-03-28 05:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 786a4281-6c4f-511b-99d5-c9e48f59eb74 with scrape type 2
2026-03-28 05:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 786a4281-6c4f-511b-99d5-c9e48f59eb74, identifier: LS81640
2026-03-28 05:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 786a4281-6c4f-511b-99d5-c9e48f59eb74 with identifier: LS81640
2026-03-28 05:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 786a4281-6c4f-511b-99d5-c9e48f59eb74 with identifier: LS81640
2026-03-28 05:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 786a4281-6c4f-511b-99d5-c9e48f59eb74 with identifier: LS81640 to the API
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:20Z',
 'fuel_type': 'petrol',
 'id': '786a4281-6c4f-511b-99d5-c9e48f59eb74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS81640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 82526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 FSI Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2006}
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS81640%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Saving data for LS81640: {'auction_closing_time': 1774715540.0, 'created_time': 1774468293.208812, 'last_price_update_time': 1774676503.455131}
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS81640') HTTP/1.1" 204 0
2026-03-28 05:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98131%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for HG98131: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for PK47596: 0
2026-03-28 05:41:43 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Scrape type for PY46067: 2
2026-03-28 05:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-28 05:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb06dd25-b60f-520c-871a-a275b2853488 with scrape type 2
2026-03-28 05:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb06dd25-b60f-520c-871a-a275b2853488 with scrape type 2
2026-03-28 05:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb06dd25-b60f-520c-871a-a275b2853488, identifier: PY46067
2026-03-28 05:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-28 05:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-28 05:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067 to the API
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:46:08Z',
 'fuel_type': 'diesel',
 'id': 'bb06dd25-b60f-520c-871a-a275b2853488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY46067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 142725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-28 05:41:43 [auto1.de] INFO: Saving data for PY46067: {'auction_closing_time': 1774716368.0, 'created_time': 1774552710.696205, 'last_price_update_time': 1774676503.98216}
2026-03-28 05:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY46067') HTTP/1.1" 204 0
2026-03-28 05:41:44 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-28 05:41:44 [auto1.de] INFO: Scrape type for BJ29098: 2
2026-03-28 05:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-28 05:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42801f89-0201-5eb3-a5b4-bc63e9600db1 with scrape type 2
2026-03-28 05:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42801f89-0201-5eb3-a5b4-bc63e9600db1 with scrape type 2
2026-03-28 05:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42801f89-0201-5eb3-a5b4-bc63e9600db1, identifier: BJ29098
2026-03-28 05:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-28 05:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-28 05:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098 to the API
2026-03-28 05:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:55:09Z',
 'fuel_type': 'diesel',
 'id': '42801f89-0201-5eb3-a5b4-bc63e9600db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ29098',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 137410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Saving data for BJ29098: {'auction_closing_time': 1774716909.0, 'created_time': 1774552723.170192, 'last_price_update_time': 1774676505.214981}
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ29098') HTTP/1.1" 204 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for RF22787: 2
2026-03-28 05:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-28 05:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c170e4c-8714-56e3-a319-107793e738c4 with scrape type 2
2026-03-28 05:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c170e4c-8714-56e3-a319-107793e738c4 with scrape type 2
2026-03-28 05:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c170e4c-8714-56e3-a319-107793e738c4, identifier: RF22787
2026-03-28 05:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-28 05:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-28 05:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787 to the API
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:54:24Z',
 'fuel_type': 'petrol',
 'id': '8c170e4c-8714-56e3-a319-107793e738c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF22787',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 130926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-16',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Saving data for RF22787: {'auction_closing_time': 1774716864.0, 'created_time': 1774551884.670844, 'last_price_update_time': 1774676505.726335}
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF22787') HTTP/1.1" 204 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM53441%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for HM53441: 0
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-28 05:41:45 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT68679%27 HTTP/1.1" 200 None
2026-03-28 05:41:45 [auto1.de] INFO: Scrape type for JT68679: 2
2026-03-28 05:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d824fbd-795d-570a-bebb-d83de9e43fd9 with identifier: JT68679
2026-03-28 05:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d824fbd-795d-570a-bebb-d83de9e43fd9 with scrape type 2
2026-03-28 05:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d824fbd-795d-570a-bebb-d83de9e43fd9 with scrape type 2
2026-03-28 05:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d824fbd-795d-570a-bebb-d83de9e43fd9, identifier: JT68679
2026-03-28 05:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d824fbd-795d-570a-bebb-d83de9e43fd9 with identifier: JT68679
2026-03-28 05:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d824fbd-795d-570a-bebb-d83de9e43fd9 with identifier: JT68679
2026-03-28 05:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d824fbd-795d-570a-bebb-d83de9e43fd9 with identifier: JT68679 to the API
2026-03-28 05:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:18Z',
 'fuel_type': 'diesel',
 'id': '6d824fbd-795d-570a-bebb-d83de9e43fd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT68679',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 149650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2022}
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT68679%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Saving data for JT68679: {'auction_closing_time': 1774715958.0, 'created_time': 1774466364.981067, 'last_price_update_time': 1774676506.238556}
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT68679') HTTP/1.1" 204 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for MT59111: 2
2026-03-28 05:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-28 05:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fedb076-2f34-58c3-8ce0-690f0857368d with scrape type 2
2026-03-28 05:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fedb076-2f34-58c3-8ce0-690f0857368d with scrape type 2
2026-03-28 05:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fedb076-2f34-58c3-8ce0-690f0857368d, identifier: MT59111
2026-03-28 05:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-28 05:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-28 05:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111 to the API
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'diesel',
 'id': '8fedb076-2f34-58c3-8ce0-690f0857368d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT59111',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 296218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-13',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Saving data for MT59111: {'auction_closing_time': 1774715778.0, 'created_time': 1773946805.151834, 'last_price_update_time': 1774676506.712013}
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT59111') HTTP/1.1" 204 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH03969%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for JH03969: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ59997%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for HZ59997: 0
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-28 05:41:46 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-28 05:41:46 [auto1.de] INFO: Scrape type for SV23538: 2
2026-03-28 05:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-28 05:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a260994-1221-5049-84dd-c183eb88833e with scrape type 2
2026-03-28 05:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a260994-1221-5049-84dd-c183eb88833e with scrape type 2
2026-03-28 05:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a260994-1221-5049-84dd-c183eb88833e, identifier: SV23538
2026-03-28 05:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-28 05:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-28 05:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538 to the API
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:25:43Z',
 'fuel_type': 'diesel',
 'id': '2a260994-1221-5049-84dd-c183eb88833e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV23538',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 359865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Saving data for SV23538: {'auction_closing_time': 1774715143.0, 'created_time': 1774553090.271447, 'last_price_update_time': 1774676507.272524}
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV23538') HTTP/1.1" 204 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73589%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for CV73589: 2
2026-03-28 05:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with identifier: CV73589
2026-03-28 05:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with scrape type 2
2026-03-28 05:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with scrape type 2
2026-03-28 05:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e16a69be-ca5b-5b59-af53-42f22d7d9ed2, identifier: CV73589
2026-03-28 05:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with identifier: CV73589
2026-03-28 05:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with identifier: CV73589
2026-03-28 05:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e16a69be-ca5b-5b59-af53-42f22d7d9ed2 with identifier: CV73589 to the API
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:08Z',
 'fuel_type': 'petrol',
 'id': 'e16a69be-ca5b-5b59-af53-42f22d7d9ed2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV73589',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 82437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-15',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2021}
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73589%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Saving data for CV73589: {'auction_closing_time': 1774716728.0, 'created_time': 1774552824.641505, 'last_price_update_time': 1774676507.689936}
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV73589') HTTP/1.1" 204 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: DP75483
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP75483%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for DP75483: 0
2026-03-28 05:41:47 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-28 05:41:47 [auto1.de] INFO: Scrape type for ED94101: 2
2026-03-28 05:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-28 05:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be8bb19-b84f-5882-8825-f4acb815fc9b with scrape type 2
2026-03-28 05:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be8bb19-b84f-5882-8825-f4acb815fc9b with scrape type 2
2026-03-28 05:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8be8bb19-b84f-5882-8825-f4acb815fc9b, identifier: ED94101
2026-03-28 05:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-28 05:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-28 05:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101 to the API
2026-03-28 05:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:03:36Z',
 'fuel_type': 'diesel',
 'id': '8be8bb19-b84f-5882-8825-f4acb815fc9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED94101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 500991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Saving data for ED94101: {'auction_closing_time': 1774713816.0, 'created_time': 1774551262.967739, 'last_price_update_time': 1774676508.237152}
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED94101') HTTP/1.1" 204 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX17640%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for HX17640: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU59007%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for NU59007: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD58556%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for AD58556: 2
2026-03-28 05:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f64443da-63f7-5297-ba8a-6fed6b943e73 with identifier: AD58556
2026-03-28 05:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f64443da-63f7-5297-ba8a-6fed6b943e73 with scrape type 2
2026-03-28 05:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f64443da-63f7-5297-ba8a-6fed6b943e73 with scrape type 2
2026-03-28 05:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f64443da-63f7-5297-ba8a-6fed6b943e73, identifier: AD58556
2026-03-28 05:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f64443da-63f7-5297-ba8a-6fed6b943e73 with identifier: AD58556
2026-03-28 05:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f64443da-63f7-5297-ba8a-6fed6b943e73 with identifier: AD58556
2026-03-28 05:41:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f64443da-63f7-5297-ba8a-6fed6b943e73 with identifier: AD58556 to the API
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:39:59Z',
 'fuel_type': 'petrol',
 'id': 'f64443da-63f7-5297-ba8a-6fed6b943e73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD58556',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 275541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-03',
 'seller_name': None,
 'title': 'Mazda 6 2.5 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD58556%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Saving data for AD58556: {'auction_closing_time': 1774715999.0, 'created_time': 1773345819.528085, 'last_price_update_time': 1774676508.783415}
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD58556') HTTP/1.1" 204 0
2026-03-28 05:41:48 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64211%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for XW64211: 0
2026-03-28 05:41:48 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN56676%27 HTTP/1.1" 200 None
2026-03-28 05:41:48 [auto1.de] INFO: Scrape type for HN56676: 2
2026-03-28 05:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3960fb1-396a-56a1-911f-01dc77c1b6ca with identifier: HN56676
2026-03-28 05:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3960fb1-396a-56a1-911f-01dc77c1b6ca with scrape type 2
2026-03-28 05:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3960fb1-396a-56a1-911f-01dc77c1b6ca with scrape type 2
2026-03-28 05:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3960fb1-396a-56a1-911f-01dc77c1b6ca, identifier: HN56676
2026-03-28 05:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3960fb1-396a-56a1-911f-01dc77c1b6ca with identifier: HN56676
2026-03-28 05:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3960fb1-396a-56a1-911f-01dc77c1b6ca with identifier: HN56676
2026-03-28 05:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3960fb1-396a-56a1-911f-01dc77c1b6ca with identifier: HN56676 to the API
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:32:17Z',
 'fuel_type': 'diesel',
 'id': 'c3960fb1-396a-56a1-911f-01dc77c1b6ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN56676',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 186759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2017}
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN56676%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Saving data for HN56676: {'auction_closing_time': 1774715537.0, 'created_time': 1773229331.90775, 'last_price_update_time': 1774676509.281209}
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN56676') HTTP/1.1" 204 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for NK37699: 2
2026-03-28 05:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-28 05:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba37cedc-0681-5c99-865e-5a588f41e654 with scrape type 2
2026-03-28 05:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba37cedc-0681-5c99-865e-5a588f41e654 with scrape type 2
2026-03-28 05:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba37cedc-0681-5c99-865e-5a588f41e654, identifier: NK37699
2026-03-28 05:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-28 05:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-28 05:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699 to the API
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:14:18Z',
 'fuel_type': 'petrol',
 'id': 'ba37cedc-0681-5c99-865e-5a588f41e654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK37699',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 108322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Saving data for NK37699: {'auction_closing_time': 1774714458.0, 'created_time': 1774552826.580332, 'last_price_update_time': 1774676509.730243}
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK37699') HTTP/1.1" 204 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD93265%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for UD93265: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE14454%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for RE14454: 0
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-28 05:41:49 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-28 05:41:49 [auto1.de] INFO: Scrape type for NY81856: 2
2026-03-28 05:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-28 05:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with scrape type 2
2026-03-28 05:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with scrape type 2
2026-03-28 05:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0, identifier: NY81856
2026-03-28 05:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-28 05:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-28 05:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856 to the API
2026-03-28 05:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:58:25Z',
 'fuel_type': 'petrol',
 'id': '9b8e70ca-5a1c-5323-ae27-0a2931fb98d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY81856',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 185557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Saving data for NY81856: {'auction_closing_time': 1774717105.0, 'created_time': 1774552811.73772, 'last_price_update_time': 1774676510.205255}
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY81856') HTTP/1.1" 204 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for ZE88330: 2
2026-03-28 05:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-28 05:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with scrape type 2
2026-03-28 05:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with scrape type 2
2026-03-28 05:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef, identifier: ZE88330
2026-03-28 05:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-28 05:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-28 05:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330 to the API
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:38:32Z',
 'fuel_type': 'petrol',
 'id': '60c8b276-41f2-54f3-9c67-bd0cb68c4fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE88330',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 79292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Saving data for ZE88330: {'auction_closing_time': 1774715912.0, 'created_time': 1773132276.849646, 'last_price_update_time': 1774676510.790019}
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE88330') HTTP/1.1" 204 0
2026-03-28 05:41:50 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-28 05:41:50 [auto1.de] INFO: Scrape type for MC57954: 2
2026-03-28 05:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-28 05:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19824232-d35a-5f2f-96d9-1d79da51bb38 with scrape type 2
2026-03-28 05:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19824232-d35a-5f2f-96d9-1d79da51bb38 with scrape type 2
2026-03-28 05:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19824232-d35a-5f2f-96d9-1d79da51bb38, identifier: MC57954
2026-03-28 05:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-28 05:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-28 05:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954 to the API
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:12Z',
 'fuel_type': 'diesel',
 'id': '19824232-d35a-5f2f-96d9-1d79da51bb38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC57954',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 329350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Saving data for MC57954: {'auction_closing_time': 1774714872.0, 'created_time': 1773945880.527781, 'last_price_update_time': 1774676511.248878}
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC57954') HTTP/1.1" 204 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ67048%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for RZ67048: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG85593%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for MG85593: 2
2026-03-28 05:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f230d95-54e5-58a6-95b2-382e64833942 with identifier: MG85593
2026-03-28 05:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f230d95-54e5-58a6-95b2-382e64833942 with scrape type 2
2026-03-28 05:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f230d95-54e5-58a6-95b2-382e64833942 with scrape type 2
2026-03-28 05:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f230d95-54e5-58a6-95b2-382e64833942, identifier: MG85593
2026-03-28 05:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f230d95-54e5-58a6-95b2-382e64833942 with identifier: MG85593
2026-03-28 05:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f230d95-54e5-58a6-95b2-382e64833942 with identifier: MG85593
2026-03-28 05:41:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f230d95-54e5-58a6-95b2-382e64833942 with identifier: MG85593 to the API
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:22Z',
 'fuel_type': 'diesel',
 'id': '2f230d95-54e5-58a6-95b2-382e64833942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG85593',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 58365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid L1 Active',
 'transmission': 'manual',
 'trim': 'L1 Active',
 'year': 2021}
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG85593%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Saving data for MG85593: {'auction_closing_time': 1774714582.0, 'created_time': 1774552724.646766, 'last_price_update_time': 1774676511.743799}
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG85593') HTTP/1.1" 204 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU77143%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for RU77143: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP51565%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for CP51565: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40015%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for GB40015: 0
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-28 05:41:51 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-28 05:41:51 [auto1.de] INFO: Scrape type for SS59240: 2
2026-03-28 05:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-28 05:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2955a693-3b8c-5ccd-9e66-529e53940ef8 with scrape type 2
2026-03-28 05:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2955a693-3b8c-5ccd-9e66-529e53940ef8 with scrape type 2
2026-03-28 05:41:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2955a693-3b8c-5ccd-9e66-529e53940ef8, identifier: SS59240
2026-03-28 05:41:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-28 05:41:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-28 05:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240 to the API
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:34:58Z',
 'fuel_type': 'petrol',
 'id': '2955a693-3b8c-5ccd-9e66-529e53940ef8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS59240',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 109041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Saving data for SS59240: {'auction_closing_time': 1774715698.0, 'created_time': 1774552810.882736, 'last_price_update_time': 1774676512.265775}
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS59240') HTTP/1.1" 204 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK15259%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for JK15259: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV63861%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for RV63861: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL17270%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for KL17270: 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for XD50788: 2
2026-03-28 05:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-28 05:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4a42b3-4b02-52fe-8493-c672054efd61 with scrape type 2
2026-03-28 05:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4a42b3-4b02-52fe-8493-c672054efd61 with scrape type 2
2026-03-28 05:41:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee4a42b3-4b02-52fe-8493-c672054efd61, identifier: XD50788
2026-03-28 05:41:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-28 05:41:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-28 05:41:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788 to the API
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:40:04Z',
 'fuel_type': 'petrol',
 'id': 'ee4a42b3-4b02-52fe-8493-c672054efd61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD50788',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 164780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Saving data for XD50788: {'auction_closing_time': 1774716004.0, 'created_time': 1774553185.823239, 'last_price_update_time': 1774676512.893012}
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD50788') HTTP/1.1" 204 0
2026-03-28 05:41:52 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-28 05:41:52 [auto1.de] INFO: Scrape type for VL75204: 2
2026-03-28 05:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-28 05:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b38b0a-54ad-571b-bcbf-48cb169af21c with scrape type 2
2026-03-28 05:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36b38b0a-54ad-571b-bcbf-48cb169af21c with scrape type 2
2026-03-28 05:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36b38b0a-54ad-571b-bcbf-48cb169af21c, identifier: VL75204
2026-03-28 05:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-28 05:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-28 05:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204 to the API
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'petrol',
 'id': '36b38b0a-54ad-571b-bcbf-48cb169af21c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL75204',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 183596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'BMW 5er 540i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Saving data for VL75204: {'auction_closing_time': 1774714494.0, 'created_time': 1773306871.782916, 'last_price_update_time': 1774676513.432885}
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL75204') HTTP/1.1" 204 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for BY18801: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98150%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for ZL98150: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL06364%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for PL06364: 0
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-28 05:41:53 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:53 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90581%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Scrape type for NF90581: 2
2026-03-28 05:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with identifier: NF90581
2026-03-28 05:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with scrape type 2
2026-03-28 05:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with scrape type 2
2026-03-28 05:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31, identifier: NF90581
2026-03-28 05:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with identifier: NF90581
2026-03-28 05:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with identifier: NF90581
2026-03-28 05:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fc0ebda-967e-5c5f-9566-43f5ceaaaa31 with identifier: NF90581 to the API
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:18Z',
 'fuel_type': 'petrol',
 'id': '0fc0ebda-967e-5c5f-9566-43f5ceaaaa31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF90581',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-30',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90581%27 HTTP/1.1" 200 None
2026-03-28 05:41:53 [auto1.de] INFO: Saving data for NF90581: {'auction_closing_time': 1774716498.0, 'created_time': 1774467745.841766, 'last_price_update_time': 1774676513.93899}
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF90581') HTTP/1.1" 204 0
2026-03-28 05:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:54 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 05:41:54 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 05:41:54 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-28 05:41:54 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-28 05:41:54 [auto1.de] INFO: Scrape type for PG96137: 2
2026-03-28 05:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-28 05:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with scrape type 2
2026-03-28 05:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with scrape type 2
2026-03-28 05:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c587baa0-ea6d-5899-9247-93b9b9d3d4b5, identifier: PG96137
2026-03-28 05:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-28 05:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-28 05:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137 to the API
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:37:35Z',
 'fuel_type': 'petrol',
 'id': 'c587baa0-ea6d-5899-9247-93b9b9d3d4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG96137',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 8321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2024}
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-28 05:41:54 [auto1.de] INFO: Saving data for PG96137: {'auction_closing_time': 1774715855.0, 'created_time': 1774551554.027858, 'last_price_update_time': 1774676514.583826}
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG96137') HTTP/1.1" 204 0
2026-03-28 05:41:54 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-28 05:41:54 [auto1.de] INFO: Scrape type for WV38848: 2
2026-03-28 05:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-28 05:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with scrape type 2
2026-03-28 05:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with scrape type 2
2026-03-28 05:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84, identifier: WV38848
2026-03-28 05:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-28 05:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-28 05:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848 to the API
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:20:50Z',
 'fuel_type': 'diesel',
 'id': 'f569cbb2-3e4d-5bb1-983d-a9a4e9644e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV38848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 110095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2016}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Saving data for WV38848: {'auction_closing_time': 1774714850.0, 'created_time': 1774551666.419073, 'last_price_update_time': 1774676515.037254}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV38848') HTTP/1.1" 204 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ66698%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for GZ66698: 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for GX28379: 2
2026-03-28 05:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-28 05:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-28 05:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f16c2869-a320-5d78-8ff0-a08e0efa122f with scrape type 2
2026-03-28 05:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f16c2869-a320-5d78-8ff0-a08e0efa122f, identifier: GX28379
2026-03-28 05:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-28 05:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379
2026-03-28 05:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f16c2869-a320-5d78-8ff0-a08e0efa122f with identifier: GX28379 to the API
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:08:04Z',
 'fuel_type': 'petrol',
 'id': 'f16c2869-a320-5d78-8ff0-a08e0efa122f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX28379',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'MPV',
 'odometer': 336066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-26',
 'seller_name': None,
 'title': 'Mazda MPV 2.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2001}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Saving data for GX28379: {'auction_closing_time': 1774714084.0, 'created_time': 1774034569.837588, 'last_price_update_time': 1774676515.529287}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX28379') HTTP/1.1" 204 0
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-28 05:41:55 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63650%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Scrape type for TW63650: 2
2026-03-28 05:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with identifier: TW63650
2026-03-28 05:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with scrape type 2
2026-03-28 05:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with scrape type 2
2026-03-28 05:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3, identifier: TW63650
2026-03-28 05:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with identifier: TW63650
2026-03-28 05:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with identifier: TW63650
2026-03-28 05:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b4174e7-5ec5-51b2-9cc5-9754bf5649f3 with identifier: TW63650 to the API
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:28:23Z',
 'fuel_type': 'petrol',
 'id': '2b4174e7-5ec5-51b2-9cc5-9754bf5649f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW63650',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 162187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-22',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition 111 "Jahre"',
 'transmission': 'manual',
 'trim': 'Edition 111 "Jahre"',
 'year': 2010}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63650%27 HTTP/1.1" 200 None
2026-03-28 05:41:55 [auto1.de] INFO: Saving data for TW63650: {'auction_closing_time': 1774715303.0, 'created_time': 1774466887.962789, 'last_price_update_time': 1774676515.94698}
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW63650') HTTP/1.1" 204 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for DX51383: 2
2026-03-28 05:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-28 05:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1dabef-d9e1-5b40-9260-70bed80d76fb with scrape type 2
2026-03-28 05:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab1dabef-d9e1-5b40-9260-70bed80d76fb with scrape type 2
2026-03-28 05:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab1dabef-d9e1-5b40-9260-70bed80d76fb, identifier: DX51383
2026-03-28 05:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-28 05:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-28 05:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383 to the API
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:58Z',
 'fuel_type': 'diesel',
 'id': 'ab1dabef-d9e1-5b40-9260-70bed80d76fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX51383',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 135955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Saving data for DX51383: {'auction_closing_time': 1774715278.0, 'created_time': 1774553022.334996, 'last_price_update_time': 1774676516.479939}
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX51383') HTTP/1.1" 204 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: HM98480
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP04235%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for UP04235: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05561%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for BN05561: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA46324%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for BA46324: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP52094%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for EP52094: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-28 05:41:56 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA77724%27 HTTP/1.1" 200 None
2026-03-28 05:41:56 [auto1.de] INFO: Scrape type for XA77724: 2
2026-03-28 05:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with identifier: XA77724
2026-03-28 05:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with scrape type 2
2026-03-28 05:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with scrape type 2
2026-03-28 05:41:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12d79855-67ce-5fc0-9d9b-25dc7902e1f1, identifier: XA77724
2026-03-28 05:41:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with identifier: XA77724
2026-03-28 05:41:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with identifier: XA77724
2026-03-28 05:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12d79855-67ce-5fc0-9d9b-25dc7902e1f1 with identifier: XA77724 to the API
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:59Z',
 'fuel_type': 'diesel',
 'id': '12d79855-67ce-5fc0-9d9b-25dc7902e1f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA77724',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 194957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 dCi Energy Bose Edition',
 'transmission': 'automatic',
 'trim': 'Bose Edition',
 'year': 2015}
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA77724%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Saving data for XA77724: {'auction_closing_time': 1774716119.0, 'created_time': 1774468245.097497, 'last_price_update_time': 1774676517.063362}
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA77724') HTTP/1.1" 204 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR35172%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for FR35172: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB38135%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for UB38135: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF71090%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for BF71090: 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for WX30438: 2
2026-03-28 05:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-28 05:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e79b38e0-290e-52a4-bbb1-8507bb9e3959 with scrape type 2
2026-03-28 05:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e79b38e0-290e-52a4-bbb1-8507bb9e3959 with scrape type 2
2026-03-28 05:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e79b38e0-290e-52a4-bbb1-8507bb9e3959, identifier: WX30438
2026-03-28 05:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-28 05:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-28 05:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438 to the API
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:40:02Z',
 'fuel_type': 'petrol',
 'id': 'e79b38e0-290e-52a4-bbb1-8507bb9e3959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX30438',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 132987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2018}
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Saving data for WX30438: {'auction_closing_time': 1774716002.0, 'created_time': 1774552882.18503, 'last_price_update_time': 1774676517.667813}
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX30438') HTTP/1.1" 204 0
2026-03-28 05:41:57 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU34646%27 HTTP/1.1" 200 None
2026-03-28 05:41:57 [auto1.de] INFO: Scrape type for GU34646: 0
2026-03-28 05:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:41:58 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9199 | hits on page: 40
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE89968%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for VE89968: 2
2026-03-28 05:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 495ac772-ac50-5c9c-9f48-e6cc229bf702 with identifier: VE89968
2026-03-28 05:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495ac772-ac50-5c9c-9f48-e6cc229bf702 with scrape type 2
2026-03-28 05:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 495ac772-ac50-5c9c-9f48-e6cc229bf702 with scrape type 2
2026-03-28 05:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 495ac772-ac50-5c9c-9f48-e6cc229bf702, identifier: VE89968
2026-03-28 05:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 495ac772-ac50-5c9c-9f48-e6cc229bf702 with identifier: VE89968
2026-03-28 05:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 495ac772-ac50-5c9c-9f48-e6cc229bf702 with identifier: VE89968
2026-03-28 05:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 495ac772-ac50-5c9c-9f48-e6cc229bf702 with identifier: VE89968 to the API
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:27:02Z',
 'fuel_type': 'petrol',
 'id': '495ac772-ac50-5c9c-9f48-e6cc229bf702',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE89968',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 271808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE89968%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Saving data for VE89968: {'auction_closing_time': 1774715222.0, 'created_time': 1774349639.543772, 'last_price_update_time': 1774676518.584512}
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE89968') HTTP/1.1" 204 0
2026-03-28 05:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:41:58 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-28 05:41:58 [auto1.de] INFO: Scrape type for GR33012: 2
2026-03-28 05:41:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-28 05:41:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d735fb-5107-5167-af9f-0874cff56b62 with scrape type 2
2026-03-28 05:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d735fb-5107-5167-af9f-0874cff56b62 with scrape type 2
2026-03-28 05:41:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d735fb-5107-5167-af9f-0874cff56b62, identifier: GR33012
2026-03-28 05:41:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-28 05:41:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-28 05:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012 to the API
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:43:55Z',
 'fuel_type': 'diesel',
 'id': '41d735fb-5107-5167-af9f-0874cff56b62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR33012',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 301933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline 4Motion',
 'transmission': 'manual',
 'trim': 'Comfortline 4Motion',
 'year': 2008}
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Saving data for GR33012: {'auction_closing_time': 1774716235.0, 'created_time': 1774551878.415461, 'last_price_update_time': 1774676519.014879}
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR33012') HTTP/1.1" 204 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE62650%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for CE62650: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT72928%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for PT72928: 2
2026-03-28 05:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with identifier: PT72928
2026-03-28 05:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with scrape type 2
2026-03-28 05:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with scrape type 2
2026-03-28 05:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 674a07f1-6028-5cde-8fcc-1ff98c8f9d86, identifier: PT72928
2026-03-28 05:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with identifier: PT72928
2026-03-28 05:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with identifier: PT72928
2026-03-28 05:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 674a07f1-6028-5cde-8fcc-1ff98c8f9d86 with identifier: PT72928 to the API
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'petrol',
 'id': '674a07f1-6028-5cde-8fcc-1ff98c8f9d86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT72928',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 150645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Titanium Collection',
 'transmission': 'manual',
 'trim': 'Titanium Collection',
 'year': 2011}
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT72928%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Saving data for PT72928: {'auction_closing_time': 1774716492.0, 'created_time': 1773132736.845768, 'last_price_update_time': 1774676519.535733}
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT72928') HTTP/1.1" 204 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC01823%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for FC01823: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG55269%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for YG55269: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for JV66840: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for RH52660: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN01413%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for XN01413: 0
2026-03-28 05:41:59 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL85430%27 HTTP/1.1" 200 None
2026-03-28 05:41:59 [auto1.de] INFO: Scrape type for SL85430: 2
2026-03-28 05:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-03-28 05:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with scrape type 2
2026-03-28 05:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with scrape type 2
2026-03-28 05:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83, identifier: SL85430
2026-03-28 05:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-03-28 05:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430
2026-03-28 05:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83 with identifier: SL85430 to the API
2026-03-28 05:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:46:06Z',
 'fuel_type': 'diesel',
 'id': '7e2bf7ef-6789-5c5c-a475-05dd1e2b5f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL85430',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 112954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-10',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.0 TDI Kasten 35 mittellang Hochdach FWD',
 'transmission': 'manual',
 'trim': 'Kasten 35 mittellang Hochdach FWD',
 'year': 2021}
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL85430%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Saving data for SL85430: {'auction_closing_time': 1774716366.0, 'created_time': 1774503358.99412, 'last_price_update_time': 1774676520.804024}
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL85430') HTTP/1.1" 204 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH73994%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for BH73994: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-28 05:42:00 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-28 05:42:00 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK74950%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for CK74950: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for NH53597: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB52853%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for AB52853: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU59477%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for KU59477: 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72684%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for RW72684: 2
2026-03-28 05:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88811659-6551-5b5b-93d2-fc290a6e3cc2 with identifier: RW72684
2026-03-28 05:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88811659-6551-5b5b-93d2-fc290a6e3cc2 with scrape type 2
2026-03-28 05:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88811659-6551-5b5b-93d2-fc290a6e3cc2 with scrape type 2
2026-03-28 05:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88811659-6551-5b5b-93d2-fc290a6e3cc2, identifier: RW72684
2026-03-28 05:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88811659-6551-5b5b-93d2-fc290a6e3cc2 with identifier: RW72684
2026-03-28 05:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88811659-6551-5b5b-93d2-fc290a6e3cc2 with identifier: RW72684
2026-03-28 05:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88811659-6551-5b5b-93d2-fc290a6e3cc2 with identifier: RW72684 to the API
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:18:21Z',
 'fuel_type': 'diesel',
 'id': '88811659-6551-5b5b-93d2-fc290a6e3cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW72684',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 125090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-08',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72684%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Saving data for RW72684: {'auction_closing_time': 1774714701.0, 'created_time': 1774467943.834102, 'last_price_update_time': 1774676521.516791}
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW72684') HTTP/1.1" 204 0
2026-03-28 05:42:01 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-28 05:42:01 [auto1.de] INFO: Scrape type for PN56757: 2
2026-03-28 05:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-28 05:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4172f75-4525-5e28-acee-47c42dbd55fc with scrape type 2
2026-03-28 05:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4172f75-4525-5e28-acee-47c42dbd55fc with scrape type 2
2026-03-28 05:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4172f75-4525-5e28-acee-47c42dbd55fc, identifier: PN56757
2026-03-28 05:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-28 05:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-28 05:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757 to the API
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:04Z',
 'fuel_type': 'diesel',
 'id': 'f4172f75-4525-5e28-acee-47c42dbd55fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN56757',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 180218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2017}
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Saving data for PN56757: {'auction_closing_time': 1774716844.0, 'created_time': 1773917518.051252, 'last_price_update_time': 1774676522.094068}
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN56757') HTTP/1.1" 204 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU10500%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for MU10500: 0
2026-03-28 05:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:02 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 05:42:02 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-28 05:42:02 [auto1.de] INFO: Scrape type for SG08680: 2
2026-03-28 05:42:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-28 05:42:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with scrape type 2
2026-03-28 05:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with scrape type 2
2026-03-28 05:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47, identifier: SG08680
2026-03-28 05:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-28 05:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-28 05:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680 to the API
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'diesel',
 'id': '95d659b7-d6a6-54fa-8a5c-8c85eaa55a47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG08680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 372220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-07',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Saving data for SG08680: {'auction_closing_time': 1774713810.0, 'created_time': 1773946867.65972, 'last_price_update_time': 1774676523.039681}
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG08680') HTTP/1.1" 204 0
2026-03-28 05:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM93791%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for ZM93791: 0
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV44298%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for KV44298: 0
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM74841%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for XM74841: 0
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF12602%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for GF12602: 0
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH70383%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for GH70383: 2
2026-03-28 05:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-03-28 05:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d29eb19-ec57-5d13-aae5-789da9230f13 with scrape type 2
2026-03-28 05:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d29eb19-ec57-5d13-aae5-789da9230f13 with scrape type 2
2026-03-28 05:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d29eb19-ec57-5d13-aae5-789da9230f13, identifier: GH70383
2026-03-28 05:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-03-28 05:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383
2026-03-28 05:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d29eb19-ec57-5d13-aae5-789da9230f13 with identifier: GH70383 to the API
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:49Z',
 'fuel_type': 'diesel',
 'id': '1d29eb19-ec57-5d13-aae5-789da9230f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH70383',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 325746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH70383%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Saving data for GH70383: {'auction_closing_time': 1774715989.0, 'created_time': 1774468196.855316, 'last_price_update_time': 1774676523.594968}
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH70383') HTTP/1.1" 204 0
2026-03-28 05:42:03 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-28 05:42:03 [auto1.de] INFO: Scrape type for CX46071: 2
2026-03-28 05:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-28 05:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6925a86a-8f55-5bbb-beff-34d1f7ece30b with scrape type 2
2026-03-28 05:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6925a86a-8f55-5bbb-beff-34d1f7ece30b with scrape type 2
2026-03-28 05:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6925a86a-8f55-5bbb-beff-34d1f7ece30b, identifier: CX46071
2026-03-28 05:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-28 05:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-28 05:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071 to the API
2026-03-28 05:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:21Z',
 'fuel_type': 'petrol',
 'id': '6925a86a-8f55-5bbb-beff-34d1f7ece30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX46071',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 60158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Saving data for CX46071: {'auction_closing_time': 1774715481.0, 'created_time': 1774552773.781723, 'last_price_update_time': 1774676524.132426}
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX46071') HTTP/1.1" 204 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for KE44581: 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE29079%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for LE29079: 2
2026-03-28 05:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with identifier: LE29079
2026-03-28 05:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with scrape type 2
2026-03-28 05:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with scrape type 2
2026-03-28 05:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0673a1c9-22cf-5a3e-b1df-68189dab1a7a, identifier: LE29079
2026-03-28 05:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with identifier: LE29079
2026-03-28 05:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with identifier: LE29079
2026-03-28 05:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0673a1c9-22cf-5a3e-b1df-68189dab1a7a with identifier: LE29079 to the API
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:43:03Z',
 'fuel_type': 'petrol',
 'id': '0673a1c9-22cf-5a3e-b1df-68189dab1a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE29079',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 76470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE29079%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Saving data for LE29079: {'auction_closing_time': 1774716183.0, 'created_time': 1774466812.323853, 'last_price_update_time': 1774676524.647947}
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE29079') HTTP/1.1" 204 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92411%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for WM92411: 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE04478%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for PE04478: 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 05:42:04 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS45558%27 HTTP/1.1" 200 None
2026-03-28 05:42:04 [auto1.de] INFO: Scrape type for LS45558: 2
2026-03-28 05:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f81ad813-753f-54ac-8913-c921c4da6c19 with identifier: LS45558
2026-03-28 05:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f81ad813-753f-54ac-8913-c921c4da6c19 with scrape type 2
2026-03-28 05:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f81ad813-753f-54ac-8913-c921c4da6c19 with scrape type 2
2026-03-28 05:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f81ad813-753f-54ac-8913-c921c4da6c19, identifier: LS45558
2026-03-28 05:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f81ad813-753f-54ac-8913-c921c4da6c19 with identifier: LS45558
2026-03-28 05:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f81ad813-753f-54ac-8913-c921c4da6c19 with identifier: LS45558
2026-03-28 05:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f81ad813-753f-54ac-8913-c921c4da6c19 with identifier: LS45558 to the API
2026-03-28 05:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:37:30Z',
 'fuel_type': 'diesel',
 'id': 'f81ad813-753f-54ac-8913-c921c4da6c19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS45558',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 126380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-25',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 2.0 JTDM Turismo',
 'transmission': 'automatic',
 'trim': 'Turismo',
 'year': 2014}
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS45558%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Saving data for LS45558: {'auction_closing_time': 1774715850.0, 'created_time': 1774034856.267289, 'last_price_update_time': 1774676525.144139}
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS45558') HTTP/1.1" 204 0
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW74206%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Scrape type for DW74206: 0
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP35153%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Scrape type for PP35153: 2
2026-03-28 05:42:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with identifier: PP35153
2026-03-28 05:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with scrape type 2
2026-03-28 05:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with scrape type 2
2026-03-28 05:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b, identifier: PP35153
2026-03-28 05:42:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with identifier: PP35153
2026-03-28 05:42:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with identifier: PP35153
2026-03-28 05:42:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a079bf8-9c13-5405-8b0a-57d54cdd7e5b with identifier: PP35153 to the API
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:33:13Z',
 'fuel_type': 'petrol',
 'id': '6a079bf8-9c13-5405-8b0a-57d54cdd7e5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP35153',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 42263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-04',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Excellence Start/Stop',
 'transmission': 'manual',
 'trim': 'Excellence Start/Stop',
 'year': 2018}
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP35153%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Saving data for PP35153: {'auction_closing_time': 1774715593.0, 'created_time': 1773861689.090206, 'last_price_update_time': 1774676525.715267}
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP35153') HTTP/1.1" 204 0
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Scrape type for GT24864: 0
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-28 05:42:05 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-28 05:42:05 [auto1.de] INFO: Scrape type for FW07623: 0
2026-03-28 05:42:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:06 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:06 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-28 05:42:06 [auto1.de] INFO: Scrape type for EY26571: 2
2026-03-28 05:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-28 05:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b03218-6889-5977-8daf-14e0ba27b920 with scrape type 2
2026-03-28 05:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b03218-6889-5977-8daf-14e0ba27b920 with scrape type 2
2026-03-28 05:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b03218-6889-5977-8daf-14e0ba27b920, identifier: EY26571
2026-03-28 05:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-28 05:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-28 05:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571 to the API
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:47:57Z',
 'fuel_type': 'petrol',
 'id': '71b03218-6889-5977-8daf-14e0ba27b920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY26571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 41382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2023}
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-28 05:42:06 [auto1.de] INFO: Saving data for EY26571: {'auction_closing_time': 1774716477.0, 'created_time': 1774553179.990372, 'last_price_update_time': 1774676526.673595}
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY26571') HTTP/1.1" 204 0
2026-03-28 05:42:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:06 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ79532%27 HTTP/1.1" 200 None
2026-03-28 05:42:06 [auto1.de] INFO: Scrape type for SZ79532: 2
2026-03-28 05:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with identifier: SZ79532
2026-03-28 05:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with scrape type 2
2026-03-28 05:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with scrape type 2
2026-03-28 05:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8552ee7b-65e7-5955-bba1-a23bdda6dc72, identifier: SZ79532
2026-03-28 05:42:06 [scrapy.extensions.logstats] INFO: Crawled 134 pages (at 15 pages/min), scraped 504 items (at 87 items/min)
2026-03-28 05:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with identifier: SZ79532
2026-03-28 05:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with identifier: SZ79532
2026-03-28 05:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8552ee7b-65e7-5955-bba1-a23bdda6dc72 with identifier: SZ79532 to the API
2026-03-28 05:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:30:33Z',
 'fuel_type': 'hybrid',
 'id': '8552ee7b-65e7-5955-bba1-a23bdda6dc72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ79532',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 226641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2019}
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ79532%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Saving data for SZ79532: {'auction_closing_time': 1774715433.0, 'created_time': 1774467835.186162, 'last_price_update_time': 1774676527.155268}
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ79532') HTTP/1.1" 204 0
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS36937%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Scrape type for XS36937: 0
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH78360%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Scrape type for DH78360: 0
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Scrape type for BM31151: 2
2026-03-28 05:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-28 05:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f69d09c-69bb-5ea1-a963-c9317750b1ab with scrape type 2
2026-03-28 05:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f69d09c-69bb-5ea1-a963-c9317750b1ab with scrape type 2
2026-03-28 05:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f69d09c-69bb-5ea1-a963-c9317750b1ab, identifier: BM31151
2026-03-28 05:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-28 05:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-28 05:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151 to the API
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:07:55Z',
 'fuel_type': 'petrol',
 'id': '7f69d09c-69bb-5ea1-a963-c9317750b1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM31151',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 181794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Saving data for BM31151: {'auction_closing_time': 1774714075.0, 'created_time': 1774551119.478608, 'last_price_update_time': 1774676527.732272}
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM31151') HTTP/1.1" 204 0
2026-03-28 05:42:07 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX36775%27 HTTP/1.1" 200 None
2026-03-28 05:42:07 [auto1.de] INFO: Scrape type for KX36775: 2
2026-03-28 05:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with identifier: KX36775
2026-03-28 05:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with scrape type 2
2026-03-28 05:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with scrape type 2
2026-03-28 05:42:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93, identifier: KX36775
2026-03-28 05:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with identifier: KX36775
2026-03-28 05:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with identifier: KX36775
2026-03-28 05:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0c03a03-36ee-57bc-b8c1-a32bf9e6fa93 with identifier: KX36775 to the API
2026-03-28 05:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:08:10Z',
 'fuel_type': 'hybrid',
 'id': 'd0c03a03-36ee-57bc-b8c1-a32bf9e6fa93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX36775',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 70016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX36775%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Saving data for KX36775: {'auction_closing_time': 1774714090.0, 'created_time': 1774468210.02081, 'last_price_update_time': 1774676528.211431}
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX36775') HTTP/1.1" 204 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM32956%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for JM32956: 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ44071%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for GJ44071: 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP55300%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for RP55300: 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for AJ98197: 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE09834%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for NE09834: 2
2026-03-28 05:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3949771d-d365-5c2b-a33f-b1c1a7defaed with identifier: NE09834
2026-03-28 05:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3949771d-d365-5c2b-a33f-b1c1a7defaed with scrape type 2
2026-03-28 05:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3949771d-d365-5c2b-a33f-b1c1a7defaed with scrape type 2
2026-03-28 05:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3949771d-d365-5c2b-a33f-b1c1a7defaed, identifier: NE09834
2026-03-28 05:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3949771d-d365-5c2b-a33f-b1c1a7defaed with identifier: NE09834
2026-03-28 05:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3949771d-d365-5c2b-a33f-b1c1a7defaed with identifier: NE09834
2026-03-28 05:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3949771d-d365-5c2b-a33f-b1c1a7defaed with identifier: NE09834 to the API
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'diesel',
 'id': '3949771d-d365-5c2b-a33f-b1c1a7defaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE09834',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 217592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-30',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE09834%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Saving data for NE09834: {'auction_closing_time': 1774716114.0, 'created_time': 1774464261.041187, 'last_price_update_time': 1774676528.755418}
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE09834') HTTP/1.1" 204 0
2026-03-28 05:42:08 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU78449%27 HTTP/1.1" 200 None
2026-03-28 05:42:08 [auto1.de] INFO: Scrape type for XU78449: 2
2026-03-28 05:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48cacb57-f310-5c68-a9ed-671895bfeed5 with identifier: XU78449
2026-03-28 05:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48cacb57-f310-5c68-a9ed-671895bfeed5 with scrape type 2
2026-03-28 05:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48cacb57-f310-5c68-a9ed-671895bfeed5 with scrape type 2
2026-03-28 05:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48cacb57-f310-5c68-a9ed-671895bfeed5, identifier: XU78449
2026-03-28 05:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48cacb57-f310-5c68-a9ed-671895bfeed5 with identifier: XU78449
2026-03-28 05:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48cacb57-f310-5c68-a9ed-671895bfeed5 with identifier: XU78449
2026-03-28 05:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48cacb57-f310-5c68-a9ed-671895bfeed5 with identifier: XU78449 to the API
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:20:29Z',
 'fuel_type': 'petrol',
 'id': '48cacb57-f310-5c68-a9ed-671895bfeed5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU78449',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 103249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-04',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU78449%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Saving data for XU78449: {'auction_closing_time': 1774714829.0, 'created_time': 1774035054.209812, 'last_price_update_time': 1774676529.33382}
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU78449') HTTP/1.1" 204 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG42712%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for WG42712: 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for XF30370: 2
2026-03-28 05:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-28 05:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1beb75-1855-59de-9a72-2fba70207d40 with scrape type 2
2026-03-28 05:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb1beb75-1855-59de-9a72-2fba70207d40 with scrape type 2
2026-03-28 05:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb1beb75-1855-59de-9a72-2fba70207d40, identifier: XF30370
2026-03-28 05:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-28 05:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-28 05:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370 to the API
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:28:54Z',
 'fuel_type': 'petrol',
 'id': 'eb1beb75-1855-59de-9a72-2fba70207d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF30370',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 153257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Saving data for XF30370: {'auction_closing_time': 1774715334.0, 'created_time': 1774552705.540188, 'last_price_update_time': 1774676529.76649}
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF30370') HTTP/1.1" 204 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX96397%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for UX96397: 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for MD28081: 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-28 05:42:09 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37576%27 HTTP/1.1" 200 None
2026-03-28 05:42:09 [auto1.de] INFO: Scrape type for HH37576: 2
2026-03-28 05:42:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71f10aca-778a-5ae6-bacd-9eea880d7463 with identifier: HH37576
2026-03-28 05:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71f10aca-778a-5ae6-bacd-9eea880d7463 with scrape type 2
2026-03-28 05:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71f10aca-778a-5ae6-bacd-9eea880d7463 with scrape type 2
2026-03-28 05:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71f10aca-778a-5ae6-bacd-9eea880d7463, identifier: HH37576
2026-03-28 05:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71f10aca-778a-5ae6-bacd-9eea880d7463 with identifier: HH37576
2026-03-28 05:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71f10aca-778a-5ae6-bacd-9eea880d7463 with identifier: HH37576
2026-03-28 05:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71f10aca-778a-5ae6-bacd-9eea880d7463 with identifier: HH37576 to the API
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:31:56Z',
 'fuel_type': 'petrol',
 'id': '71f10aca-778a-5ae6-bacd-9eea880d7463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH37576',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 40633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-06',
 'seller_name': None,
 'title': 'Honda Jazz 1.3 i-VTEC Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2018}
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37576%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Saving data for HH37576: {'auction_closing_time': 1774715516.0, 'created_time': 1774465804.561748, 'last_price_update_time': 1774676530.379224}
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH37576') HTTP/1.1" 204 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA30463%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for FA30463: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX20208%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for KX20208: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS12616%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for BS12616: 0
2026-03-28 05:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:10 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY95420%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for HY95420: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for WT92496: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK36338%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for RK36338: 0
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 05:42:10 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-28 05:42:10 [auto1.de] INFO: Scrape type for LN34178: 2
2026-03-28 05:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-28 05:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a92c413a-46c7-58ac-854a-d9aac97ba7df with scrape type 2
2026-03-28 05:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a92c413a-46c7-58ac-854a-d9aac97ba7df with scrape type 2
2026-03-28 05:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a92c413a-46c7-58ac-854a-d9aac97ba7df, identifier: LN34178
2026-03-28 05:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-28 05:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-28 05:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178 to the API
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:24:35Z',
 'fuel_type': 'petrol',
 'id': 'a92c413a-46c7-58ac-854a-d9aac97ba7df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN34178',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 145253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2009}
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Saving data for LN34178: {'auction_closing_time': 1774715075.0, 'created_time': 1773946934.032415, 'last_price_update_time': 1774676531.235482}
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN34178') HTTP/1.1" 204 0
2026-03-28 05:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for WG27498: 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: US80699
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB62942%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for GB62942: 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for LL54952: 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU80644%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for DU80644: 2
2026-03-28 05:42:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97d05afa-d3a9-5dc3-a105-fe06bf43250c with identifier: DU80644
2026-03-28 05:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97d05afa-d3a9-5dc3-a105-fe06bf43250c with scrape type 2
2026-03-28 05:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97d05afa-d3a9-5dc3-a105-fe06bf43250c with scrape type 2
2026-03-28 05:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97d05afa-d3a9-5dc3-a105-fe06bf43250c, identifier: DU80644
2026-03-28 05:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97d05afa-d3a9-5dc3-a105-fe06bf43250c with identifier: DU80644
2026-03-28 05:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97d05afa-d3a9-5dc3-a105-fe06bf43250c with identifier: DU80644
2026-03-28 05:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97d05afa-d3a9-5dc3-a105-fe06bf43250c with identifier: DU80644 to the API
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:24Z',
 'fuel_type': 'diesel',
 'id': '97d05afa-d3a9-5dc3-a105-fe06bf43250c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU80644',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 115917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-25',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D3 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2018}
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU80644%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Saving data for DU80644: {'auction_closing_time': 1774715724.0, 'created_time': 1773136725.46722, 'last_price_update_time': 1774676531.865695}
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU80644') HTTP/1.1" 204 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG98793%27 HTTP/1.1" 200 None
2026-03-28 05:42:11 [auto1.de] INFO: Scrape type for YG98793: 0
2026-03-28 05:42:11 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN92027%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Scrape type for ZN92027: 2
2026-03-28 05:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 623ef923-4f80-5b1e-aaa4-74780a318025 with identifier: ZN92027
2026-03-28 05:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 623ef923-4f80-5b1e-aaa4-74780a318025 with scrape type 2
2026-03-28 05:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 623ef923-4f80-5b1e-aaa4-74780a318025 with scrape type 2
2026-03-28 05:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 623ef923-4f80-5b1e-aaa4-74780a318025, identifier: ZN92027
2026-03-28 05:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 623ef923-4f80-5b1e-aaa4-74780a318025 with identifier: ZN92027
2026-03-28 05:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 623ef923-4f80-5b1e-aaa4-74780a318025 with identifier: ZN92027
2026-03-28 05:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 623ef923-4f80-5b1e-aaa4-74780a318025 with identifier: ZN92027 to the API
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:27:45Z',
 'fuel_type': 'diesel',
 'id': '623ef923-4f80-5b1e-aaa4-74780a318025',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN92027',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 191541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-14',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN92027%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Saving data for ZN92027: {'auction_closing_time': 1774715265.0, 'created_time': 1774464430.450152, 'last_price_update_time': 1774676532.448306}
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN92027') HTTP/1.1" 204 0
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT99674%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Scrape type for AT99674: 0
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-28 05:42:12 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-28 05:42:12 [auto1.de] INFO: Scrape type for CR61198: 2
2026-03-28 05:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-28 05:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with scrape type 2
2026-03-28 05:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with scrape type 2
2026-03-28 05:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38, identifier: CR61198
2026-03-28 05:42:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-28 05:42:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-28 05:42:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198 to the API
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:45:44Z',
 'fuel_type': 'diesel',
 'id': '2ac005df-39ad-5cf6-86e6-deda5dbf0f38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR61198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 151539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-28 05:42:13 [auto1.de] INFO: Saving data for CR61198: {'auction_closing_time': 1774716344.0, 'created_time': 1774552740.41681, 'last_price_update_time': 1774676533.034918}
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR61198') HTTP/1.1" 204 0
2026-03-28 05:42:13 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26668%27 HTTP/1.1" 200 None
2026-03-28 05:42:13 [auto1.de] INFO: Scrape type for DZ26668: 0
2026-03-28 05:42:13 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-28 05:42:13 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX85164%27 HTTP/1.1" 200 None
2026-03-28 05:42:13 [auto1.de] INFO: Scrape type for FX85164: 0
2026-03-28 05:42:13 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-28 05:42:13 [auto1.de] INFO: Scrape type for MD91791: 2
2026-03-28 05:42:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-28 05:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e8051e-099b-54a9-a118-ef40653b11b5 with scrape type 2
2026-03-28 05:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e8051e-099b-54a9-a118-ef40653b11b5 with scrape type 2
2026-03-28 05:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04e8051e-099b-54a9-a118-ef40653b11b5, identifier: MD91791
2026-03-28 05:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-28 05:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791
2026-03-28 05:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04e8051e-099b-54a9-a118-ef40653b11b5 with identifier: MD91791 to the API
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'petrol',
 'id': '04e8051e-099b-54a9-a118-ef40653b11b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD91791',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 152105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-04',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR Edition',
 'transmission': 'automatic',
 'trim': 'FR Edition',
 'year': 2019}
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-28 05:42:13 [auto1.de] INFO: Saving data for MD91791: {'auction_closing_time': 1774714147.0, 'created_time': 1773307415.878536, 'last_price_update_time': 1774676533.600271}
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD91791') HTTP/1.1" 204 0
2026-03-28 05:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:14 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX93358%27 HTTP/1.1" 200 None
2026-03-28 05:42:14 [auto1.de] INFO: Scrape type for BX93358: 2
2026-03-28 05:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95515971-da9a-55f9-91ea-146cc1eb533e with identifier: BX93358
2026-03-28 05:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95515971-da9a-55f9-91ea-146cc1eb533e with scrape type 2
2026-03-28 05:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95515971-da9a-55f9-91ea-146cc1eb533e with scrape type 2
2026-03-28 05:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95515971-da9a-55f9-91ea-146cc1eb533e, identifier: BX93358
2026-03-28 05:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95515971-da9a-55f9-91ea-146cc1eb533e with identifier: BX93358
2026-03-28 05:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95515971-da9a-55f9-91ea-146cc1eb533e with identifier: BX93358
2026-03-28 05:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95515971-da9a-55f9-91ea-146cc1eb533e with identifier: BX93358 to the API
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:06:35Z',
 'fuel_type': 'diesel',
 'id': '95515971-da9a-55f9-91ea-146cc1eb533e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX93358',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 250202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 CRDi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX93358%27 HTTP/1.1" 200 None
2026-03-28 05:42:14 [auto1.de] INFO: Saving data for BX93358: {'auction_closing_time': 1774713995.0, 'created_time': 1774464081.022137, 'last_price_update_time': 1774676534.846086}
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX93358') HTTP/1.1" 204 0
2026-03-28 05:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-28 05:42:14 [auto1.de] INFO: Scrape type for KJ44451: 0
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 05:42:14 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-28 05:42:14 [auto1.de] INFO: Scrape type for MU97238: 2
2026-03-28 05:42:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-28 05:42:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16933ab5-691f-572a-908c-ec8524b5b724 with scrape type 2
2026-03-28 05:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16933ab5-691f-572a-908c-ec8524b5b724 with scrape type 2
2026-03-28 05:42:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16933ab5-691f-572a-908c-ec8524b5b724, identifier: MU97238
2026-03-28 05:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-28 05:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-28 05:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238 to the API
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:34:46Z',
 'fuel_type': 'petrol',
 'id': '16933ab5-691f-572a-908c-ec8524b5b724',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU97238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 136719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-23',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2011}
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Saving data for MU97238: {'auction_closing_time': 1774715686.0, 'created_time': 1774552694.833639, 'last_price_update_time': 1774676535.302343}
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU97238') HTTP/1.1" 204 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP26466%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for KP26466: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for SD16829: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for EU27466: 0
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-28 05:42:15 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG47316%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Scrape type for BG47316: 2
2026-03-28 05:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10393b84-9803-58ad-82f0-b807cbaa1061 with identifier: BG47316
2026-03-28 05:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10393b84-9803-58ad-82f0-b807cbaa1061 with scrape type 2
2026-03-28 05:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10393b84-9803-58ad-82f0-b807cbaa1061 with scrape type 2
2026-03-28 05:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10393b84-9803-58ad-82f0-b807cbaa1061, identifier: BG47316
2026-03-28 05:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10393b84-9803-58ad-82f0-b807cbaa1061 with identifier: BG47316
2026-03-28 05:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10393b84-9803-58ad-82f0-b807cbaa1061 with identifier: BG47316
2026-03-28 05:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10393b84-9803-58ad-82f0-b807cbaa1061 with identifier: BG47316 to the API
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'petrol',
 'id': '10393b84-9803-58ad-82f0-b807cbaa1061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG47316',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 94237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet Comfort +',
 'transmission': 'automatic',
 'trim': 'Comfort +',
 'year': 2017}
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG47316%27 HTTP/1.1" 200 None
2026-03-28 05:42:15 [auto1.de] INFO: Saving data for BG47316: {'auction_closing_time': 1774715959.0, 'created_time': 1774466771.177976, 'last_price_update_time': 1774676535.931452}
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG47316') HTTP/1.1" 204 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE51742%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for TE51742: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: BU31051
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU31051%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for BU31051: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG99680%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for RG99680: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS24649%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for GS24649: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-28 05:42:16 [auto1.de] INFO: Scrape type for MV56275: 0
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-28 05:42:16 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-28 05:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:17 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED87662%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for ED87662: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR62242%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for BR62242: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31519%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for ND31519: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06950%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for MU06950: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL43025%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for GL43025: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60356%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for CG60356: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV90927%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for BV90927: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29574%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for AU29574: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for ME72354: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ04555%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for KJ04555: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR68171%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for PR68171: 2
2026-03-28 05:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with identifier: PR68171
2026-03-28 05:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with scrape type 2
2026-03-28 05:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with scrape type 2
2026-03-28 05:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2372cc09-8d01-531c-9a7b-00cc70f2f4f7, identifier: PR68171
2026-03-28 05:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with identifier: PR68171
2026-03-28 05:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with identifier: PR68171
2026-03-28 05:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2372cc09-8d01-531c-9a7b-00cc70f2f4f7 with identifier: PR68171 to the API
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'petrol',
 'id': '2372cc09-8d01-531c-9a7b-00cc70f2f4f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR68171',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 54240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-27',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2019}
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR68171%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Saving data for PR68171: {'auction_closing_time': 1774714429.0, 'created_time': 1774553219.889301, 'last_price_update_time': 1774676537.787809}
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR68171') HTTP/1.1" 204 0
2026-03-28 05:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA84874%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for GA84874: 0
2026-03-28 05:42:17 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-28 05:42:17 [auto1.de] INFO: Scrape type for WW51915: 2
2026-03-28 05:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-28 05:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8ca480-cc53-53cb-8d52-b70ca3d6072c with scrape type 2
2026-03-28 05:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba8ca480-cc53-53cb-8d52-b70ca3d6072c with scrape type 2
2026-03-28 05:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba8ca480-cc53-53cb-8d52-b70ca3d6072c, identifier: WW51915
2026-03-28 05:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-28 05:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-28 05:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915 to the API
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:16Z',
 'fuel_type': 'petrol',
 'id': 'ba8ca480-cc53-53cb-8d52-b70ca3d6072c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW51915',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 59835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-07',
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Saving data for WW51915: {'auction_closing_time': 1774717036.0, 'created_time': 1774552723.959915, 'last_price_update_time': 1774676538.351986}
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW51915') HTTP/1.1" 204 0
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90686%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Scrape type for FU90686: 0
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Scrape type for LR95574: 2
2026-03-28 05:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-28 05:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f9888e9-5198-55d5-bf70-5a63223f2854 with scrape type 2
2026-03-28 05:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f9888e9-5198-55d5-bf70-5a63223f2854 with scrape type 2
2026-03-28 05:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f9888e9-5198-55d5-bf70-5a63223f2854, identifier: LR95574
2026-03-28 05:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-28 05:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-28 05:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574 to the API
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:48:28Z',
 'fuel_type': 'petrol',
 'id': '1f9888e9-5198-55d5-bf70-5a63223f2854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR95574',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 172225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Saving data for LR95574: {'auction_closing_time': 1774716508.0, 'created_time': 1774551195.190847, 'last_price_update_time': 1774676538.894567}
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR95574') HTTP/1.1" 204 0
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-28 05:42:18 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98905%27 HTTP/1.1" 200 None
2026-03-28 05:42:18 [auto1.de] INFO: Scrape type for ZR98905: 2
2026-03-28 05:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c676878-60f9-5d2c-8290-df88bb1ef197 with identifier: ZR98905
2026-03-28 05:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c676878-60f9-5d2c-8290-df88bb1ef197 with scrape type 2
2026-03-28 05:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c676878-60f9-5d2c-8290-df88bb1ef197 with scrape type 2
2026-03-28 05:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c676878-60f9-5d2c-8290-df88bb1ef197, identifier: ZR98905
2026-03-28 05:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c676878-60f9-5d2c-8290-df88bb1ef197 with identifier: ZR98905
2026-03-28 05:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c676878-60f9-5d2c-8290-df88bb1ef197 with identifier: ZR98905
2026-03-28 05:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c676878-60f9-5d2c-8290-df88bb1ef197 with identifier: ZR98905 to the API
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:45:24Z',
 'fuel_type': 'petrol',
 'id': '2c676878-60f9-5d2c-8290-df88bb1ef197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR98905',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 19991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-16',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98905%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Saving data for ZR98905: {'auction_closing_time': 1774716324.0, 'created_time': 1774467051.61311, 'last_price_update_time': 1774676539.332765}
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR98905') HTTP/1.1" 204 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for EL53532: 2
2026-03-28 05:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-28 05:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1452076-a771-5491-99e3-8f5b32f10c86 with scrape type 2
2026-03-28 05:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1452076-a771-5491-99e3-8f5b32f10c86 with scrape type 2
2026-03-28 05:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1452076-a771-5491-99e3-8f5b32f10c86, identifier: EL53532
2026-03-28 05:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-28 05:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-28 05:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532 to the API
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:17:01Z',
 'fuel_type': 'diesel',
 'id': 'd1452076-a771-5491-99e3-8f5b32f10c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL53532',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 141857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI PanAmericana 4Motion',
 'transmission': 'automatic',
 'trim': 'PanAmericana 4Motion',
 'year': 2019}
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Saving data for EL53532: {'auction_closing_time': 1774714621.0, 'created_time': 1774551117.734145, 'last_price_update_time': 1774676539.768857}
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL53532') HTTP/1.1" 204 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN87452%27 HTTP/1.1" 200 None
2026-03-28 05:42:19 [auto1.de] INFO: Scrape type for JN87452: 0
2026-03-28 05:42:19 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-28 05:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:20 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:20 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63843%27 HTTP/1.1" 200 None
2026-03-28 05:42:20 [auto1.de] INFO: Scrape type for SJ63843: 2
2026-03-28 05:42:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with identifier: SJ63843
2026-03-28 05:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with scrape type 2
2026-03-28 05:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with scrape type 2
2026-03-28 05:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 679ff1f2-236f-5046-88f1-3ff2f564ceb1, identifier: SJ63843
2026-03-28 05:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with identifier: SJ63843
2026-03-28 05:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with identifier: SJ63843
2026-03-28 05:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 679ff1f2-236f-5046-88f1-3ff2f564ceb1 with identifier: SJ63843 to the API
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:32:33Z',
 'fuel_type': 'diesel',
 'id': '679ff1f2-236f-5046-88f1-3ff2f564ceb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ63843',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 179547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-16',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63843%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Saving data for SJ63843: {'auction_closing_time': 1774715553.0, 'created_time': 1774467839.632238, 'last_price_update_time': 1774676541.257394}
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ63843') HTTP/1.1" 204 0
2026-03-28 05:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ68210%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for VZ68210: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for GM26241: 2
2026-03-28 05:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-28 05:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6334e9bb-547e-51c2-bda8-b609649751c8 with scrape type 2
2026-03-28 05:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6334e9bb-547e-51c2-bda8-b609649751c8 with scrape type 2
2026-03-28 05:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6334e9bb-547e-51c2-bda8-b609649751c8, identifier: GM26241
2026-03-28 05:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-28 05:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241
2026-03-28 05:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6334e9bb-547e-51c2-bda8-b609649751c8 with identifier: GM26241 to the API
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:56:05Z',
 'fuel_type': 'petrol',
 'id': '6334e9bb-547e-51c2-bda8-b609649751c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM26241',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 33717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-13',
 'seller_name': None,
 'title': 'BMW 2er M235i Gran Coupe xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2023}
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Saving data for GM26241: {'auction_closing_time': 1774716965.0, 'created_time': 1773134273.835797, 'last_price_update_time': 1774676541.895601}
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM26241') HTTP/1.1" 204 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for LH84474: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77632%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for CL77632: 0
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-28 05:42:21 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA94662%27 HTTP/1.1" 200 None
2026-03-28 05:42:21 [auto1.de] INFO: Scrape type for GA94662: 2
2026-03-28 05:42:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84f0b137-efb1-5ca9-a549-b159469a491c with identifier: GA94662
2026-03-28 05:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84f0b137-efb1-5ca9-a549-b159469a491c with scrape type 2
2026-03-28 05:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84f0b137-efb1-5ca9-a549-b159469a491c with scrape type 2
2026-03-28 05:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84f0b137-efb1-5ca9-a549-b159469a491c, identifier: GA94662
2026-03-28 05:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84f0b137-efb1-5ca9-a549-b159469a491c with identifier: GA94662
2026-03-28 05:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84f0b137-efb1-5ca9-a549-b159469a491c with identifier: GA94662
2026-03-28 05:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84f0b137-efb1-5ca9-a549-b159469a491c with identifier: GA94662 to the API
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:11:37Z',
 'fuel_type': 'petrol',
 'id': '84f0b137-efb1-5ca9-a549-b159469a491c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA94662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 65702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI BlueMotion',
 'year': 2018}
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA94662%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Saving data for GA94662: {'auction_closing_time': 1774714297.0, 'created_time': 1773137743.859377, 'last_price_update_time': 1774676542.45909}
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA94662') HTTP/1.1" 204 0
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-28 05:42:22 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-28 05:42:22 [auto1.de] INFO: Scrape type for PG24274: 2
2026-03-28 05:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-28 05:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 2
2026-03-28 05:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 2
2026-03-28 05:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3a45927-1997-5e4c-af77-e3843bf636a7, identifier: PG24274
2026-03-28 05:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-28 05:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-28 05:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274 to the API
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:08Z',
 'fuel_type': 'petrol',
 'id': 'c3a45927-1997-5e4c-af77-e3843bf636a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24274',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TSI ACT BlueGT',
 'transmission': 'manual',
 'trim': 'BlueGT',
 'year': 2015}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Saving data for PG24274: {'auction_closing_time': 1774716188.0, 'created_time': 1773947037.30325, 'last_price_update_time': 1774676543.04231}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24274') HTTP/1.1" 204 0
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA89414%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Scrape type for LA89414: 2
2026-03-28 05:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c620510f-58ab-5b1e-99b5-1c43ace663be with identifier: LA89414
2026-03-28 05:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c620510f-58ab-5b1e-99b5-1c43ace663be with scrape type 2
2026-03-28 05:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c620510f-58ab-5b1e-99b5-1c43ace663be with scrape type 2
2026-03-28 05:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c620510f-58ab-5b1e-99b5-1c43ace663be, identifier: LA89414
2026-03-28 05:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c620510f-58ab-5b1e-99b5-1c43ace663be with identifier: LA89414
2026-03-28 05:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c620510f-58ab-5b1e-99b5-1c43ace663be with identifier: LA89414
2026-03-28 05:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c620510f-58ab-5b1e-99b5-1c43ace663be with identifier: LA89414 to the API
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:07:50Z',
 'fuel_type': 'diesel',
 'id': 'c620510f-58ab-5b1e-99b5-1c43ace663be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA89414',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 26780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-05-18',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi EcoBlue 320 L2 Titanium',
 'transmission': 'manual',
 'trim': '320 L2 Titanium',
 'year': 2025}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA89414%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Saving data for LA89414: {'auction_closing_time': 1774714070.0, 'created_time': 1774553247.887171, 'last_price_update_time': 1774676543.480199}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA89414') HTTP/1.1" 204 0
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW14529%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Scrape type for VW14529: 2
2026-03-28 05:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beb66054-cc95-5753-8ca4-2d71ee70bff9 with identifier: VW14529
2026-03-28 05:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beb66054-cc95-5753-8ca4-2d71ee70bff9 with scrape type 2
2026-03-28 05:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beb66054-cc95-5753-8ca4-2d71ee70bff9 with scrape type 2
2026-03-28 05:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beb66054-cc95-5753-8ca4-2d71ee70bff9, identifier: VW14529
2026-03-28 05:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beb66054-cc95-5753-8ca4-2d71ee70bff9 with identifier: VW14529
2026-03-28 05:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beb66054-cc95-5753-8ca4-2d71ee70bff9 with identifier: VW14529
2026-03-28 05:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beb66054-cc95-5753-8ca4-2d71ee70bff9 with identifier: VW14529 to the API
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:06Z',
 'fuel_type': 'diesel',
 'id': 'beb66054-cc95-5753-8ca4-2d71ee70bff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW14529',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 100619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-20',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach 4Motion',
 'transmission': 'automatic',
 'trim': 'Beach 4Motion',
 'year': 2018}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW14529%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Saving data for VW14529: {'auction_closing_time': 1774715166.0, 'created_time': 1773830551.76071, 'last_price_update_time': 1774676543.930268}
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW14529') HTTP/1.1" 204 0
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV76572%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Scrape type for MV76572: 0
2026-03-28 05:42:23 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY77386%27 HTTP/1.1" 200 None
2026-03-28 05:42:23 [auto1.de] INFO: Scrape type for KY77386: 2
2026-03-28 05:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b8f011-8a62-5d6f-a91f-e73f0f80929b with identifier: KY77386
2026-03-28 05:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b8f011-8a62-5d6f-a91f-e73f0f80929b with scrape type 2
2026-03-28 05:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b8f011-8a62-5d6f-a91f-e73f0f80929b with scrape type 2
2026-03-28 05:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8b8f011-8a62-5d6f-a91f-e73f0f80929b, identifier: KY77386
2026-03-28 05:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8b8f011-8a62-5d6f-a91f-e73f0f80929b with identifier: KY77386
2026-03-28 05:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8b8f011-8a62-5d6f-a91f-e73f0f80929b with identifier: KY77386
2026-03-28 05:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8b8f011-8a62-5d6f-a91f-e73f0f80929b with identifier: KY77386 to the API
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:07Z',
 'fuel_type': 'petrol',
 'id': 'f8b8f011-8a62-5d6f-a91f-e73f0f80929b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY77386',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 18983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2024}
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY77386%27 HTTP/1.1" 200 None
2026-03-28 05:42:24 [auto1.de] INFO: Saving data for KY77386: {'auction_closing_time': 1774716127.0, 'created_time': 1773861664.909443, 'last_price_update_time': 1774676544.391314}
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY77386') HTTP/1.1" 204 0
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-28 05:42:24 [auto1.de] INFO: Scrape type for HE06850: 0
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87912%27 HTTP/1.1" 200 None
2026-03-28 05:42:24 [auto1.de] INFO: Scrape type for PW87912: 2
2026-03-28 05:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d5b339-ff61-5835-860f-f91a2db4b952 with identifier: PW87912
2026-03-28 05:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d5b339-ff61-5835-860f-f91a2db4b952 with scrape type 2
2026-03-28 05:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87d5b339-ff61-5835-860f-f91a2db4b952 with scrape type 2
2026-03-28 05:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87d5b339-ff61-5835-860f-f91a2db4b952, identifier: PW87912
2026-03-28 05:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87d5b339-ff61-5835-860f-f91a2db4b952 with identifier: PW87912
2026-03-28 05:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87d5b339-ff61-5835-860f-f91a2db4b952 with identifier: PW87912
2026-03-28 05:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87d5b339-ff61-5835-860f-f91a2db4b952 with identifier: PW87912 to the API
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:01:58Z',
 'fuel_type': 'petrol',
 'id': '87d5b339-ff61-5835-860f-f91a2db4b952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW87912',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 61186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Cross BluemotionTech',
 'transmission': 'manual',
 'trim': 'Cross BluemotionTech',
 'year': 2014}
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87912%27 HTTP/1.1" 200 None
2026-03-28 05:42:24 [auto1.de] INFO: Saving data for PW87912: {'auction_closing_time': 1774713718.0, 'created_time': 1774034660.809716, 'last_price_update_time': 1774676544.871533}
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW87912') HTTP/1.1" 204 0
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX62945%27 HTTP/1.1" 200 None
2026-03-28 05:42:24 [auto1.de] INFO: Scrape type for TX62945: 0
2026-03-28 05:42:24 [auto1.de] INFO: Found listing with ID: SR33792
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33792%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for SR33792: 0
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK33233%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for VK33233: 0
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for GH07682: 0
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP43696%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for HP43696: 0
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 05:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:25 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for MB83489: 2
2026-03-28 05:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-28 05:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with scrape type 2
2026-03-28 05:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with scrape type 2
2026-03-28 05:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d31d88e2-c520-5211-aaab-e3d7d0bc08e1, identifier: MB83489
2026-03-28 05:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-28 05:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-28 05:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489 to the API
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:57:29Z',
 'fuel_type': 'diesel',
 'id': 'd31d88e2-c520-5211-aaab-e3d7d0bc08e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB83489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 67368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2020}
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Saving data for MB83489: {'auction_closing_time': 1774717049.0, 'created_time': 1774553057.533437, 'last_price_update_time': 1774676545.625943}
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB83489') HTTP/1.1" 204 0
2026-03-28 05:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:25 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH64272%27 HTTP/1.1" 200 None
2026-03-28 05:42:25 [auto1.de] INFO: Scrape type for KH64272: 2
2026-03-28 05:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c1ae42-5b80-5524-9739-89908a6c06af with identifier: KH64272
2026-03-28 05:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c1ae42-5b80-5524-9739-89908a6c06af with scrape type 2
2026-03-28 05:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74c1ae42-5b80-5524-9739-89908a6c06af with scrape type 2
2026-03-28 05:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74c1ae42-5b80-5524-9739-89908a6c06af, identifier: KH64272
2026-03-28 05:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74c1ae42-5b80-5524-9739-89908a6c06af with identifier: KH64272
2026-03-28 05:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74c1ae42-5b80-5524-9739-89908a6c06af with identifier: KH64272
2026-03-28 05:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74c1ae42-5b80-5524-9739-89908a6c06af with identifier: KH64272 to the API
2026-03-28 05:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:40:04Z',
 'fuel_type': 'diesel',
 'id': '74c1ae42-5b80-5524-9739-89908a6c06af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH64272',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 86306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH64272%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Saving data for KH64272: {'auction_closing_time': 1774716004.0, 'created_time': 1774466571.536278, 'last_price_update_time': 1774676546.153623}
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH64272') HTTP/1.1" 204 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP86097%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for DP86097: 2
2026-03-28 05:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with identifier: DP86097
2026-03-28 05:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with scrape type 2
2026-03-28 05:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with scrape type 2
2026-03-28 05:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0096f64c-f5fc-5663-86af-4b47ff3f13b2, identifier: DP86097
2026-03-28 05:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with identifier: DP86097
2026-03-28 05:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with identifier: DP86097
2026-03-28 05:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0096f64c-f5fc-5663-86af-4b47ff3f13b2 with identifier: DP86097 to the API
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:16Z',
 'fuel_type': 'petrol',
 'id': '0096f64c-f5fc-5663-86af-4b47ff3f13b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP86097',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 87958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT First Edition',
 'transmission': 'manual',
 'trim': 'First Edition',
 'year': 2020}
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP86097%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Saving data for DP86097: {'auction_closing_time': 1774714396.0, 'created_time': 1774467748.363289, 'last_price_update_time': 1774676546.629512}
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP86097') HTTP/1.1" 204 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18924%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for BS18924: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for CY25945: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH62820%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for DH62820: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for SZ82893: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB86362%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for NB86362: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT98226%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for WT98226: 0
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-28 05:42:26 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH25393%27 HTTP/1.1" 200 None
2026-03-28 05:42:26 [auto1.de] INFO: Scrape type for MH25393: 2
2026-03-28 05:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c938e237-dcdd-5bb6-844d-8431f2700479 with identifier: MH25393
2026-03-28 05:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c938e237-dcdd-5bb6-844d-8431f2700479 with scrape type 2
2026-03-28 05:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c938e237-dcdd-5bb6-844d-8431f2700479 with scrape type 2
2026-03-28 05:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c938e237-dcdd-5bb6-844d-8431f2700479, identifier: MH25393
2026-03-28 05:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c938e237-dcdd-5bb6-844d-8431f2700479 with identifier: MH25393
2026-03-28 05:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c938e237-dcdd-5bb6-844d-8431f2700479 with identifier: MH25393
2026-03-28 05:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c938e237-dcdd-5bb6-844d-8431f2700479 with identifier: MH25393 to the API
2026-03-28 05:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:53:33Z',
 'fuel_type': 'diesel',
 'id': 'c938e237-dcdd-5bb6-844d-8431f2700479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH25393',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 107724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-11',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Canyon DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Canyon DoubleCab 4Motion',
 'year': 2018}
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH25393%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Saving data for MH25393: {'auction_closing_time': 1774716813.0, 'created_time': 1774031985.895955, 'last_price_update_time': 1774676547.229791}
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH25393') HTTP/1.1" 204 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for SR72775: 2
2026-03-28 05:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-28 05:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003e8932-0c0f-5afc-9b26-bb3d304854b4 with scrape type 2
2026-03-28 05:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 003e8932-0c0f-5afc-9b26-bb3d304854b4 with scrape type 2
2026-03-28 05:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 003e8932-0c0f-5afc-9b26-bb3d304854b4, identifier: SR72775
2026-03-28 05:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-28 05:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-28 05:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775 to the API
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:49:27Z',
 'fuel_type': 'diesel',
 'id': '003e8932-0c0f-5afc-9b26-bb3d304854b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR72775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 228715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Track & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Track & Style 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Saving data for SR72775: {'auction_closing_time': 1774716567.0, 'created_time': 1772728483.99568, 'last_price_update_time': 1774676547.814006}
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR72775') HTTP/1.1" 204 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ27207%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for GZ27207: 0
2026-03-28 05:42:27 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH72065%27 HTTP/1.1" 200 None
2026-03-28 05:42:27 [auto1.de] INFO: Scrape type for BH72065: 2
2026-03-28 05:42:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27274d91-3682-54b0-9531-d1d3da7209a8 with identifier: BH72065
2026-03-28 05:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27274d91-3682-54b0-9531-d1d3da7209a8 with scrape type 2
2026-03-28 05:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27274d91-3682-54b0-9531-d1d3da7209a8 with scrape type 2
2026-03-28 05:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27274d91-3682-54b0-9531-d1d3da7209a8, identifier: BH72065
2026-03-28 05:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27274d91-3682-54b0-9531-d1d3da7209a8 with identifier: BH72065
2026-03-28 05:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27274d91-3682-54b0-9531-d1d3da7209a8 with identifier: BH72065
2026-03-28 05:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27274d91-3682-54b0-9531-d1d3da7209a8 with identifier: BH72065 to the API
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:41Z',
 'fuel_type': 'petrol',
 'id': '27274d91-3682-54b0-9531-d1d3da7209a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH72065',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '124 Spider',
 'odometer': 48519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-15',
 'seller_name': None,
 'title': 'Fiat 124 Spider 1.4 Turbo Lusso',
 'transmission': 'manual',
 'trim': 'Lusso',
 'year': 2018}
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH72065%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Saving data for BH72065: {'auction_closing_time': 1774716521.0, 'created_time': 1774464436.249599, 'last_price_update_time': 1774676548.330221}
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH72065') HTTP/1.1" 204 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for CY45921: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for GG82433: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: US88233
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28528%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for UE28528: 0
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-28 05:42:28 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY54306%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Scrape type for PY54306: 2
2026-03-28 05:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5f7ae7-9de4-5f24-a0e5-908916a8aaab with identifier: PY54306
2026-03-28 05:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5f7ae7-9de4-5f24-a0e5-908916a8aaab with scrape type 2
2026-03-28 05:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db5f7ae7-9de4-5f24-a0e5-908916a8aaab with scrape type 2
2026-03-28 05:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db5f7ae7-9de4-5f24-a0e5-908916a8aaab, identifier: PY54306
2026-03-28 05:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db5f7ae7-9de4-5f24-a0e5-908916a8aaab with identifier: PY54306
2026-03-28 05:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db5f7ae7-9de4-5f24-a0e5-908916a8aaab with identifier: PY54306
2026-03-28 05:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db5f7ae7-9de4-5f24-a0e5-908916a8aaab with identifier: PY54306 to the API
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-28T16:12:37Z',
 'fuel_type': 'petrol',
 'id': 'db5f7ae7-9de4-5f24-a0e5-908916a8aaab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY54306',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Laguna',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-10-29',
 'seller_name': None,
 'title': 'Renault Laguna 1.6 Concorde',
 'transmission': 'manual',
 'trim': 'Concorde',
 'year': 2000}
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY54306%27 HTTP/1.1" 200 None
2026-03-28 05:42:28 [auto1.de] INFO: Saving data for PY54306: {'auction_closing_time': 1774714357.0, 'created_time': 1774466339.701616, 'last_price_update_time': 1774676548.889578}
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY54306') HTTP/1.1" 204 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 05:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:29 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64798%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for EX64798: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY14478%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for WY14478: 0
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36824%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for KP36824: 2
2026-03-28 05:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with identifier: KP36824
2026-03-28 05:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with scrape type 2
2026-03-28 05:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with scrape type 2
2026-03-28 05:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 473a3664-53a9-56a0-ade5-ac5d6d2893a8, identifier: KP36824
2026-03-28 05:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with identifier: KP36824
2026-03-28 05:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with identifier: KP36824
2026-03-28 05:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 473a3664-53a9-56a0-ade5-ac5d6d2893a8 with identifier: KP36824 to the API
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'diesel',
 'id': '473a3664-53a9-56a0-ade5-ac5d6d2893a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP36824',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 166791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-28',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2021}
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36824%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Saving data for KP36824: {'auction_closing_time': 1774713709.0, 'created_time': 1773381051.765831, 'last_price_update_time': 1774676549.648829}
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP36824') HTTP/1.1" 204 0
2026-03-28 05:42:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-28 05:42:29 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX39833%27 HTTP/1.1" 200 None
2026-03-28 05:42:29 [auto1.de] INFO: Scrape type for KX39833: 2
2026-03-28 05:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b3b80d-5097-5af9-a495-26b26131ad9d with identifier: KX39833
2026-03-28 05:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b3b80d-5097-5af9-a495-26b26131ad9d with scrape type 2
2026-03-28 05:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74b3b80d-5097-5af9-a495-26b26131ad9d with scrape type 2
2026-03-28 05:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74b3b80d-5097-5af9-a495-26b26131ad9d, identifier: KX39833
2026-03-28 05:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74b3b80d-5097-5af9-a495-26b26131ad9d with identifier: KX39833
2026-03-28 05:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74b3b80d-5097-5af9-a495-26b26131ad9d with identifier: KX39833
2026-03-28 05:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74b3b80d-5097-5af9-a495-26b26131ad9d with identifier: KX39833 to the API
2026-03-28 05:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:12:40Z',
 'fuel_type': 'diesel',
 'id': '74b3b80d-5097-5af9-a495-26b26131ad9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX39833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 243795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline 4Motion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion',
 'year': 2018}
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX39833%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Saving data for KX39833: {'auction_closing_time': 1774714360.0, 'created_time': 1774468212.092753, 'last_price_update_time': 1774676550.121835}
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX39833') HTTP/1.1" 204 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA10385%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for JA10385: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG26223%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for DG26223: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD10319%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for FD10319: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK44857%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for SK44857: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for ZP35673: 2
2026-03-28 05:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-28 05:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908147d1-9630-5a6e-861e-b3e99c79dd3c with scrape type 2
2026-03-28 05:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908147d1-9630-5a6e-861e-b3e99c79dd3c with scrape type 2
2026-03-28 05:42:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 908147d1-9630-5a6e-861e-b3e99c79dd3c, identifier: ZP35673
2026-03-28 05:42:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-28 05:42:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-28 05:42:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673 to the API
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:08Z',
 'fuel_type': 'petrol',
 'id': '908147d1-9630-5a6e-861e-b3e99c79dd3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP35673',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 30877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Saving data for ZP35673: {'auction_closing_time': 1774716728.0, 'created_time': 1774553054.933137, 'last_price_update_time': 1774676550.735369}
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP35673') HTTP/1.1" 204 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK82813%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for UK82813: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for UA30528: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75717%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for LN75717: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT31160%27 HTTP/1.1" 200 None
2026-03-28 05:42:30 [auto1.de] INFO: Scrape type for ZT31160: 0
2026-03-28 05:42:30 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-28 05:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:31 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY80313%27 HTTP/1.1" 200 None
2026-03-28 05:42:31 [auto1.de] INFO: Scrape type for TY80313: 0
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 05:42:31 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB60777%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for BB60777: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP78451%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for JP78451: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG20717%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for AG20717: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX62483%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for SX62483: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW75870%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for UW75870: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC84547%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for NC84547: 2
2026-03-28 05:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe8223a4-597a-59b4-9fea-1a07aabd0d26 with identifier: NC84547
2026-03-28 05:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe8223a4-597a-59b4-9fea-1a07aabd0d26 with scrape type 2
2026-03-28 05:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe8223a4-597a-59b4-9fea-1a07aabd0d26 with scrape type 2
2026-03-28 05:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe8223a4-597a-59b4-9fea-1a07aabd0d26, identifier: NC84547
2026-03-28 05:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe8223a4-597a-59b4-9fea-1a07aabd0d26 with identifier: NC84547
2026-03-28 05:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe8223a4-597a-59b4-9fea-1a07aabd0d26 with identifier: NC84547
2026-03-28 05:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe8223a4-597a-59b4-9fea-1a07aabd0d26 with identifier: NC84547 to the API
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:23Z',
 'fuel_type': 'diesel',
 'id': 'fe8223a4-597a-59b4-9fea-1a07aabd0d26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC84547',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 125222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-19',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC84547%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Saving data for NC84547: {'auction_closing_time': 1774713863.0, 'created_time': 1774466865.225342, 'last_price_update_time': 1774676552.538156}
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC84547') HTTP/1.1" 204 0
2026-03-28 05:42:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR62816%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for UR62816: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00644%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for LC00644: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX42326%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for SX42326: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: JB63291
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB63291%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for JB63291: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: NM87111
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM87111%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for NM87111: 0
2026-03-28 05:42:32 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-28 05:42:32 [auto1.de] INFO: Scrape type for HX36326: 2
2026-03-28 05:42:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-28 05:42:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6806d95f-19f3-55b8-a38a-f5a407636989 with scrape type 2
2026-03-28 05:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6806d95f-19f3-55b8-a38a-f5a407636989 with scrape type 2
2026-03-28 05:42:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6806d95f-19f3-55b8-a38a-f5a407636989, identifier: HX36326
2026-03-28 05:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-28 05:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-28 05:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326 to the API
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-28T16:38:40Z',
 'fuel_type': 'petrol',
 'id': '6806d95f-19f3-55b8-a38a-f5a407636989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX36326',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 80990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Saving data for HX36326: {'auction_closing_time': 1774715920.0, 'created_time': 1774553221.691818, 'last_price_update_time': 1774676553.265853}
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX36326') HTTP/1.1" 204 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for YV66765: 2
2026-03-28 05:42:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-28 05:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf761f6-dcf9-5d7f-a59d-588faa441977 with scrape type 2
2026-03-28 05:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf761f6-dcf9-5d7f-a59d-588faa441977 with scrape type 2
2026-03-28 05:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf761f6-dcf9-5d7f-a59d-588faa441977, identifier: YV66765
2026-03-28 05:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-28 05:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-28 05:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765 to the API
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:19:07Z',
 'fuel_type': 'petrol',
 'id': 'fcf761f6-dcf9-5d7f-a59d-588faa441977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV66765',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 42496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Saving data for YV66765: {'auction_closing_time': 1774714747.0, 'created_time': 1774552685.661197, 'last_price_update_time': 1774676553.853119}
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV66765') HTTP/1.1" 204 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for RN84486: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: UC78818
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78818%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for UC78818: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA46995%27 HTTP/1.1" 200 None
2026-03-28 05:42:33 [auto1.de] INFO: Scrape type for VA46995: 0
2026-03-28 05:42:33 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 05:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:34 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: FR76409
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-28 05:42:34 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN86570%27 HTTP/1.1" 200 None
2026-03-28 05:42:34 [auto1.de] INFO: Scrape type for KN86570: 2
2026-03-28 05:42:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86b0c1e6-554f-5fba-a909-761a0700c824 with identifier: KN86570
2026-03-28 05:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86b0c1e6-554f-5fba-a909-761a0700c824 with scrape type 2
2026-03-28 05:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86b0c1e6-554f-5fba-a909-761a0700c824 with scrape type 2
2026-03-28 05:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86b0c1e6-554f-5fba-a909-761a0700c824, identifier: KN86570
2026-03-28 05:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86b0c1e6-554f-5fba-a909-761a0700c824 with identifier: KN86570
2026-03-28 05:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86b0c1e6-554f-5fba-a909-761a0700c824 with identifier: KN86570
2026-03-28 05:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86b0c1e6-554f-5fba-a909-761a0700c824 with identifier: KN86570 to the API
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '86b0c1e6-554f-5fba-a909-761a0700c824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN86570',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 232901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN86570%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Saving data for KN86570: {'auction_closing_time': 1774716565.0, 'created_time': 1774464308.1871, 'last_price_update_time': 1774676555.234857}
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN86570') HTTP/1.1" 204 0
2026-03-28 05:42:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: YB59373
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL77007%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for LL77007: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH65115%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for CH65115: 2
2026-03-28 05:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f225efa-9483-5a01-88a2-f3950af66f4a with identifier: CH65115
2026-03-28 05:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f225efa-9483-5a01-88a2-f3950af66f4a with scrape type 2
2026-03-28 05:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f225efa-9483-5a01-88a2-f3950af66f4a with scrape type 2
2026-03-28 05:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f225efa-9483-5a01-88a2-f3950af66f4a, identifier: CH65115
2026-03-28 05:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f225efa-9483-5a01-88a2-f3950af66f4a with identifier: CH65115
2026-03-28 05:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f225efa-9483-5a01-88a2-f3950af66f4a with identifier: CH65115
2026-03-28 05:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f225efa-9483-5a01-88a2-f3950af66f4a with identifier: CH65115 to the API
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:04:54Z',
 'fuel_type': 'petrol',
 'id': '1f225efa-9483-5a01-88a2-f3950af66f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH65115',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 168659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-28',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH65115%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Saving data for CH65115: {'auction_closing_time': 1774713894.0, 'created_time': 1774466922.771288, 'last_price_update_time': 1774676555.676736}
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH65115') HTTP/1.1" 204 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: CY78505
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for SB50693: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for PL37483: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: XD09814
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD09814%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for XD09814: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF67305%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for BF67305: 0
2026-03-28 05:42:35 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD64899%27 HTTP/1.1" 200 None
2026-03-28 05:42:35 [auto1.de] INFO: Scrape type for AD64899: 2
2026-03-28 05:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9f4c82-5150-53f5-87a1-8201de652ffb with identifier: AD64899
2026-03-28 05:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9f4c82-5150-53f5-87a1-8201de652ffb with scrape type 2
2026-03-28 05:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d9f4c82-5150-53f5-87a1-8201de652ffb with scrape type 2
2026-03-28 05:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d9f4c82-5150-53f5-87a1-8201de652ffb, identifier: AD64899
2026-03-28 05:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d9f4c82-5150-53f5-87a1-8201de652ffb with identifier: AD64899
2026-03-28 05:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d9f4c82-5150-53f5-87a1-8201de652ffb with identifier: AD64899
2026-03-28 05:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d9f4c82-5150-53f5-87a1-8201de652ffb with identifier: AD64899 to the API
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:53:14Z',
 'fuel_type': 'diesel',
 'id': '0d9f4c82-5150-53f5-87a1-8201de652ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD64899',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 219208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-11',
 'seller_name': None,
 'title': 'Audi A4 35 TDI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2021}
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD64899%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Saving data for AD64899: {'auction_closing_time': 1774716794.0, 'created_time': 1774464553.55332, 'last_price_update_time': 1774676556.29912}
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD64899') HTTP/1.1" 204 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57603%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for LK57603: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for CV84531: 2
2026-03-28 05:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-28 05:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3feddba4-b8d5-585d-84c0-9897ffd93776 with scrape type 2
2026-03-28 05:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3feddba4-b8d5-585d-84c0-9897ffd93776 with scrape type 2
2026-03-28 05:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3feddba4-b8d5-585d-84c0-9897ffd93776, identifier: CV84531
2026-03-28 05:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-28 05:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-28 05:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531 to the API
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:36:08Z',
 'fuel_type': 'petrol',
 'id': '3feddba4-b8d5-585d-84c0-9897ffd93776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV84531',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 122246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2015}
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Saving data for CV84531: {'auction_closing_time': 1774715768.0, 'created_time': 1774552372.083399, 'last_price_update_time': 1774676556.758813}
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV84531') HTTP/1.1" 204 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for PK80050: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN95806%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for UN95806: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for ZB59934: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ43799%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for GJ43799: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV29391%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for XV29391: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC29196%27 HTTP/1.1" 200 None
2026-03-28 05:42:36 [auto1.de] INFO: Scrape type for SC29196: 0
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-28 05:42:36 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ94036%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for XJ94036: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for PN52671: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for TB42941: 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: XE74160
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90714%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for DP90714: 2
2026-03-28 05:42:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with identifier: DP90714
2026-03-28 05:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with scrape type 2
2026-03-28 05:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with scrape type 2
2026-03-28 05:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7639fe-c954-5f3a-88bf-4a097e8bd074, identifier: DP90714
2026-03-28 05:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with identifier: DP90714
2026-03-28 05:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with identifier: DP90714
2026-03-28 05:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7639fe-c954-5f3a-88bf-4a097e8bd074 with identifier: DP90714 to the API
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 298,
 'expiration_date': '2026-03-28T16:24:05Z',
 'fuel_type': 'petrol',
 'id': '0c7639fe-c954-5f3a-88bf-4a097e8bd074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP90714',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XK',
 'odometer': 131421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-13',
 'seller_name': None,
 'title': 'Jaguar XK 4.2 V8',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90714%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Saving data for DP90714: {'auction_closing_time': 1774715045.0, 'created_time': 1774466435.521007, 'last_price_update_time': 1774676557.475169}
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP90714') HTTP/1.1" 204 0
2026-03-28 05:42:37 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-28 05:42:37 [auto1.de] INFO: Scrape type for AX54291: 0
2026-03-28 05:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:38 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for GY49475: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL28573%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for JL28573: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for NN77195: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: CK75631
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK75631%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for CK75631: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: ZR47880
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR47880%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for ZR47880: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: PT89540
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT89540%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for PT89540: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY41602%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for CY41602: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF01282%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for KF01282: 0
2026-03-28 05:42:38 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA51834%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Scrape type for EA51834: 2
2026-03-28 05:42:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f1efe71-f459-5be5-a64d-27f04e65cb75 with identifier: EA51834
2026-03-28 05:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f1efe71-f459-5be5-a64d-27f04e65cb75 with scrape type 2
2026-03-28 05:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f1efe71-f459-5be5-a64d-27f04e65cb75 with scrape type 2
2026-03-28 05:42:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f1efe71-f459-5be5-a64d-27f04e65cb75, identifier: EA51834
2026-03-28 05:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f1efe71-f459-5be5-a64d-27f04e65cb75 with identifier: EA51834
2026-03-28 05:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f1efe71-f459-5be5-a64d-27f04e65cb75 with identifier: EA51834
2026-03-28 05:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f1efe71-f459-5be5-a64d-27f04e65cb75 with identifier: EA51834 to the API
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:07:29Z',
 'fuel_type': 'diesel',
 'id': '9f1efe71-f459-5be5-a64d-27f04e65cb75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA51834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 183503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2017}
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA51834%27 HTTP/1.1" 200 None
2026-03-28 05:42:38 [auto1.de] INFO: Saving data for EA51834: {'auction_closing_time': 1774714049.0, 'created_time': 1774466620.359161, 'last_price_update_time': 1774676558.959721}
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA51834') HTTP/1.1" 204 0
2026-03-28 05:42:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for HJ19382: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK12376%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for GK12376: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for RZ14311: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW16070%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for VW16070: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ36583%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for HZ36583: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB47248%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for DB47248: 2
2026-03-28 05:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd47e49-61c2-5e06-b759-bca93e675764 with identifier: DB47248
2026-03-28 05:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd47e49-61c2-5e06-b759-bca93e675764 with scrape type 2
2026-03-28 05:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd47e49-61c2-5e06-b759-bca93e675764 with scrape type 2
2026-03-28 05:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd47e49-61c2-5e06-b759-bca93e675764, identifier: DB47248
2026-03-28 05:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd47e49-61c2-5e06-b759-bca93e675764 with identifier: DB47248
2026-03-28 05:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd47e49-61c2-5e06-b759-bca93e675764 with identifier: DB47248
2026-03-28 05:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd47e49-61c2-5e06-b759-bca93e675764 with identifier: DB47248 to the API
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:58:33Z',
 'fuel_type': 'petrol',
 'id': '7fd47e49-61c2-5e06-b759-bca93e675764',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB47248',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 50542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-24',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB47248%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Saving data for DB47248: {'auction_closing_time': 1774717113.0, 'created_time': 1774467708.84697, 'last_price_update_time': 1774676559.597427}
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB47248') HTTP/1.1" 204 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for PY00065: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for VL50005: 0
2026-03-28 05:42:39 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-28 05:42:39 [auto1.de] INFO: Scrape type for KH87635: 2
2026-03-28 05:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-28 05:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7cbda55-fa7e-5855-bea4-a244a835c7a9 with scrape type 2
2026-03-28 05:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7cbda55-fa7e-5855-bea4-a244a835c7a9 with scrape type 2
2026-03-28 05:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7cbda55-fa7e-5855-bea4-a244a835c7a9, identifier: KH87635
2026-03-28 05:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-28 05:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-28 05:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635 to the API
2026-03-28 05:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:04:26Z',
 'fuel_type': 'hybrid',
 'id': 'f7cbda55-fa7e-5855-bea4-a244a835c7a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH87635',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 25284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-28 05:42:40 [auto1.de] INFO: Saving data for KH87635: {'auction_closing_time': 1774713866.0, 'created_time': 1774552995.066208, 'last_price_update_time': 1774676560.216214}
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH87635') HTTP/1.1" 204 0
2026-03-28 05:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:41 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15967%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for KR15967: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for EX05236: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: KJ94433
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: PC96089
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for ZS29776: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW32993%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for GW32993: 2
2026-03-28 05:42:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with identifier: GW32993
2026-03-28 05:42:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with scrape type 2
2026-03-28 05:42:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with scrape type 2
2026-03-28 05:42:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31eae1bc-1d52-5caf-b290-8a9f4568eca8, identifier: GW32993
2026-03-28 05:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with identifier: GW32993
2026-03-28 05:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with identifier: GW32993
2026-03-28 05:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31eae1bc-1d52-5caf-b290-8a9f4568eca8 with identifier: GW32993 to the API
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:23:42Z',
 'fuel_type': 'hybrid',
 'id': '31eae1bc-1d52-5caf-b290-8a9f4568eca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW32993',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 322476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 Hybrid T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2012}
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW32993%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Saving data for GW32993: {'auction_closing_time': 1774715022.0, 'created_time': 1774034586.664925, 'last_price_update_time': 1774676561.758171}
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW32993') HTTP/1.1" 204 0
2026-03-28 05:42:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE91614%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for ZE91614: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD38661%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for MD38661: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: LW74577
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW74577%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for LW74577: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA94168%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for DA94168: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-28 05:42:41 [auto1.de] INFO: Scrape type for KV18345: 0
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-28 05:42:41 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS67228%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for CS67228: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP69664%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for AP69664: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: EV67878
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: SP13304
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for XS27718: 2
2026-03-28 05:42:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-28 05:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bee8070-daa2-5a18-986a-e5538de28975 with scrape type 2
2026-03-28 05:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bee8070-daa2-5a18-986a-e5538de28975 with scrape type 2
2026-03-28 05:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bee8070-daa2-5a18-986a-e5538de28975, identifier: XS27718
2026-03-28 05:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-28 05:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-28 05:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718 to the API
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:58Z',
 'fuel_type': 'diesel',
 'id': '5bee8070-daa2-5a18-986a-e5538de28975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS27718',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 189725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six',
 'transmission': 'automatic',
 'trim': 'Generation Six',
 'year': 2017}
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Saving data for XS27718: {'auction_closing_time': 1774717138.0, 'created_time': 1774553071.888138, 'last_price_update_time': 1774676562.547539}
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS27718') HTTP/1.1" 204 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for KY70270: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD25373%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for VD25373: 0
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 05:42:42 [auto1.de] INFO: Found listing with ID: CR67511
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR67511%27 HTTP/1.1" 200 None
2026-03-28 05:42:42 [auto1.de] INFO: Scrape type for CR67511: 0
2026-03-28 05:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:43 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10387%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for RT10387: 0
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35656%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for HF35656: 0
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for LJ58074: 0
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for YY18465: 0
2026-03-28 05:42:43 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA78002%27 HTTP/1.1" 200 None
2026-03-28 05:42:43 [auto1.de] INFO: Scrape type for RA78002: 2
2026-03-28 05:42:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1739dc0b-9973-5dfa-a558-abd802273560 with identifier: RA78002
2026-03-28 05:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1739dc0b-9973-5dfa-a558-abd802273560 with scrape type 2
2026-03-28 05:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1739dc0b-9973-5dfa-a558-abd802273560 with scrape type 2
2026-03-28 05:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1739dc0b-9973-5dfa-a558-abd802273560, identifier: RA78002
2026-03-28 05:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1739dc0b-9973-5dfa-a558-abd802273560 with identifier: RA78002
2026-03-28 05:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1739dc0b-9973-5dfa-a558-abd802273560 with identifier: RA78002
2026-03-28 05:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1739dc0b-9973-5dfa-a558-abd802273560 with identifier: RA78002 to the API
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:43:36Z',
 'fuel_type': 'petrol',
 'id': '1739dc0b-9973-5dfa-a558-abd802273560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA78002',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 190588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA78002%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Saving data for RA78002: {'auction_closing_time': 1774716216.0, 'created_time': 1774466661.555835, 'last_price_update_time': 1774676564.228013}
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA78002') HTTP/1.1" 204 0
2026-03-28 05:42:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK74587%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for DK74587: 0
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: NY29547
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AK11207
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK11207%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for AK11207: 0
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: ZY72321
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72321%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for ZY72321: 0
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN37721%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for LN37721: 0
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-28 05:42:44 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85250%27 HTTP/1.1" 200 None
2026-03-28 05:42:44 [auto1.de] INFO: Scrape type for FN85250: 2
2026-03-28 05:42:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with identifier: FN85250
2026-03-28 05:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with scrape type 2
2026-03-28 05:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with scrape type 2
2026-03-28 05:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f8ed248-bf0b-50d3-b61a-7eb96db01f28, identifier: FN85250
2026-03-28 05:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with identifier: FN85250
2026-03-28 05:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with identifier: FN85250
2026-03-28 05:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f8ed248-bf0b-50d3-b61a-7eb96db01f28 with identifier: FN85250 to the API
2026-03-28 05:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:23:38Z',
 'fuel_type': 'diesel',
 'id': '5f8ed248-bf0b-50d3-b61a-7eb96db01f28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN85250',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 142024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85250%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Saving data for FN85250: {'auction_closing_time': 1774715018.0, 'created_time': 1774467983.768182, 'last_price_update_time': 1774676565.399963}
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN85250') HTTP/1.1" 204 0
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF69717%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Scrape type for YF69717: 0
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT62851%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Scrape type for VT62851: 0
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Scrape type for DM70532: 2
2026-03-28 05:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-28 05:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42e0f728-990b-5894-acfb-528a9e42cf5e with scrape type 2
2026-03-28 05:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42e0f728-990b-5894-acfb-528a9e42cf5e with scrape type 2
2026-03-28 05:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42e0f728-990b-5894-acfb-528a9e42cf5e, identifier: DM70532
2026-03-28 05:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-28 05:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-28 05:42:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532 to the API
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:40:55Z',
 'fuel_type': 'petrol',
 'id': '42e0f728-990b-5894-acfb-528a9e42cf5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM70532',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 75544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Saving data for DM70532: {'auction_closing_time': 1774716055.0, 'created_time': 1774466025.875162, 'last_price_update_time': 1774676565.943551}
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM70532') HTTP/1.1" 204 0
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL18090%27 HTTP/1.1" 200 None
2026-03-28 05:42:45 [auto1.de] INFO: Scrape type for RL18090: 0
2026-03-28 05:42:45 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 05:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-28 05:42:46 [auto1.de] INFO: Scrape type for SS30943: 2
2026-03-28 05:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-28 05:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with scrape type 2
2026-03-28 05:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with scrape type 2
2026-03-28 05:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d, identifier: SS30943
2026-03-28 05:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-28 05:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-28 05:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943 to the API
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:43:29Z',
 'fuel_type': 'diesel',
 'id': 'd5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS30943',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 311802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-18',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-28 05:42:46 [auto1.de] INFO: Saving data for SS30943: {'auction_closing_time': 1774716209.0, 'created_time': 1774553116.658246, 'last_price_update_time': 1774676566.44523}
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS30943') HTTP/1.1" 204 0
2026-03-28 05:42:46 [auto1.de] INFO: Found listing with ID: FT69115
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT69115%27 HTTP/1.1" 200 None
2026-03-28 05:42:46 [auto1.de] INFO: Scrape type for FT69115: 0
2026-03-28 05:42:46 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-28 05:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:47 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW55343%27 HTTP/1.1" 200 None
2026-03-28 05:42:47 [auto1.de] INFO: Scrape type for TW55343: 0
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: WC00524
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV20362%27 HTTP/1.1" 200 None
2026-03-28 05:42:47 [auto1.de] INFO: Scrape type for ZV20362: 2
2026-03-28 05:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c8f9b49-b995-53b8-9274-83f9a4573c64 with identifier: ZV20362
2026-03-28 05:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c8f9b49-b995-53b8-9274-83f9a4573c64 with scrape type 2
2026-03-28 05:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c8f9b49-b995-53b8-9274-83f9a4573c64 with scrape type 2
2026-03-28 05:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c8f9b49-b995-53b8-9274-83f9a4573c64, identifier: ZV20362
2026-03-28 05:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c8f9b49-b995-53b8-9274-83f9a4573c64 with identifier: ZV20362
2026-03-28 05:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c8f9b49-b995-53b8-9274-83f9a4573c64 with identifier: ZV20362
2026-03-28 05:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c8f9b49-b995-53b8-9274-83f9a4573c64 with identifier: ZV20362 to the API
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:33:44Z',
 'fuel_type': 'petrol',
 'id': '5c8f9b49-b995-53b8-9274-83f9a4573c64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV20362',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 188054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-21',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV20362%27 HTTP/1.1" 200 None
2026-03-28 05:42:47 [auto1.de] INFO: Saving data for ZV20362: {'auction_closing_time': 1774715624.0, 'created_time': 1772728578.565932, 'last_price_update_time': 1774676567.781547}
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV20362') HTTP/1.1" 204 0
2026-03-28 05:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-28 05:42:47 [auto1.de] INFO: Scrape type for XA52388: 0
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: KU28834
2026-03-28 05:42:47 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-28 05:42:47 [auto1.de] INFO: Scrape type for AB05978: 2
2026-03-28 05:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-28 05:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with scrape type 2
2026-03-28 05:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with scrape type 2
2026-03-28 05:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344, identifier: AB05978
2026-03-28 05:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-28 05:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-28 05:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978 to the API
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:03:27Z',
 'fuel_type': 'petrol',
 'id': '94a43c6c-3af8-5b3f-b325-b7c8cf9d7344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05978',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 134740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2016}
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Saving data for AB05978: {'auction_closing_time': 1774713807.0, 'created_time': 1774552464.906415, 'last_price_update_time': 1774676568.335691}
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB05978') HTTP/1.1" 204 0
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL77539%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Scrape type for GL77539: 0
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: MF25653
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW56930%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Scrape type for GW56930: 2
2026-03-28 05:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with identifier: GW56930
2026-03-28 05:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with scrape type 2
2026-03-28 05:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with scrape type 2
2026-03-28 05:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f4f49c-55c2-5d94-97b1-b47ff0a50432, identifier: GW56930
2026-03-28 05:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with identifier: GW56930
2026-03-28 05:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with identifier: GW56930
2026-03-28 05:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f4f49c-55c2-5d94-97b1-b47ff0a50432 with identifier: GW56930 to the API
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:32:54Z',
 'fuel_type': 'petrol',
 'id': 'c2f4f49c-55c2-5d94-97b1-b47ff0a50432',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW56930',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 118692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-24',
 'seller_name': None,
 'title': 'Audi A3 1.6 Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2009}
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW56930%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Saving data for GW56930: {'auction_closing_time': 1774715574.0, 'created_time': 1774466989.993112, 'last_price_update_time': 1774676568.848508}
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW56930') HTTP/1.1" 204 0
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-28 05:42:48 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-28 05:42:48 [auto1.de] INFO: Scrape type for MC31762: 2
2026-03-28 05:42:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-28 05:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with scrape type 2
2026-03-28 05:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with scrape type 2
2026-03-28 05:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18bc4885-6d67-5e11-94b5-2cf0fe64f409, identifier: MC31762
2026-03-28 05:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-28 05:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-28 05:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762 to the API
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:06:19Z',
 'fuel_type': 'diesel',
 'id': '18bc4885-6d67-5e11-94b5-2cf0fe64f409',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC31762',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 239666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-28 05:42:49 [auto1.de] INFO: Saving data for MC31762: {'auction_closing_time': 1774713979.0, 'created_time': 1774466858.543788, 'last_price_update_time': 1774676569.384278}
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC31762') HTTP/1.1" 204 0
2026-03-28 05:42:49 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-28 05:42:49 [auto1.de] INFO: Scrape type for HT41484: 2
2026-03-28 05:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-28 05:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ae0e5c-66dd-5669-afee-f48e75c51117 with scrape type 2
2026-03-28 05:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ae0e5c-66dd-5669-afee-f48e75c51117 with scrape type 2
2026-03-28 05:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58ae0e5c-66dd-5669-afee-f48e75c51117, identifier: HT41484
2026-03-28 05:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-28 05:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-28 05:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484 to the API
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:17:52Z',
 'fuel_type': 'petrol',
 'id': '58ae0e5c-66dd-5669-afee-f48e75c51117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT41484',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 67708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-17',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2020}
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-28 05:42:49 [auto1.de] INFO: Saving data for HT41484: {'auction_closing_time': 1774714672.0, 'created_time': 1774552956.286337, 'last_price_update_time': 1774676569.875064}
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT41484') HTTP/1.1" 204 0
2026-03-28 05:42:49 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-28 05:42:49 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL37084%27 HTTP/1.1" 200 None
2026-03-28 05:42:49 [auto1.de] INFO: Scrape type for TL37084: 0
2026-03-28 05:42:49 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-28 05:42:49 [auto1.de] INFO: Scrape type for TW05581: 2
2026-03-28 05:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-28 05:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88fbd653-d026-507d-ab80-e1b146ab26eb with scrape type 2
2026-03-28 05:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88fbd653-d026-507d-ab80-e1b146ab26eb with scrape type 2
2026-03-28 05:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88fbd653-d026-507d-ab80-e1b146ab26eb, identifier: TW05581
2026-03-28 05:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-28 05:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-28 05:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581 to the API
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-28T16:26:09Z',
 'fuel_type': 'petrol',
 'id': '88fbd653-d026-507d-ab80-e1b146ab26eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW05581',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 6396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-18',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-28 05:42:50 [auto1.de] INFO: Saving data for TW05581: {'auction_closing_time': 1774715169.0, 'created_time': 1774552899.094239, 'last_price_update_time': 1774676570.332319}
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW05581') HTTP/1.1" 204 0
2026-03-28 05:42:50 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD14562%27 HTTP/1.1" 200 None
2026-03-28 05:42:50 [auto1.de] INFO: Scrape type for RD14562: 0
2026-03-28 05:42:50 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-28 05:42:50 [auto1.de] INFO: Scrape type for FB48782: 2
2026-03-28 05:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-28 05:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84a779f-3d14-5e6f-87e9-6edd144e1c07 with scrape type 2
2026-03-28 05:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84a779f-3d14-5e6f-87e9-6edd144e1c07 with scrape type 2
2026-03-28 05:42:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84a779f-3d14-5e6f-87e9-6edd144e1c07, identifier: FB48782
2026-03-28 05:42:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-28 05:42:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-28 05:42:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782 to the API
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:11:47Z',
 'fuel_type': 'diesel',
 'id': 'd84a779f-3d14-5e6f-87e9-6edd144e1c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB48782',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 156872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-28 05:42:50 [auto1.de] INFO: Saving data for FB48782: {'auction_closing_time': 1774714307.0, 'created_time': 1774551868.889514, 'last_price_update_time': 1774676570.883354}
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB48782') HTTP/1.1" 204 0
2026-03-28 05:42:50 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-28 05:42:50 [auto1.de] INFO: Scrape type for BE47693: 2
2026-03-28 05:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-28 05:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with scrape type 2
2026-03-28 05:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with scrape type 2
2026-03-28 05:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1, identifier: BE47693
2026-03-28 05:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-28 05:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-28 05:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693 to the API
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'diesel',
 'id': 'ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE47693',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 68297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Fiat Talento 2.0 Turbodiesel Ecojet L1H1 1,0t SX',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t SX',
 'year': 2020}
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Saving data for BE47693: {'auction_closing_time': 1774716759.0, 'created_time': 1774552608.08393, 'last_price_update_time': 1774676571.343427}
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE47693') HTTP/1.1" 204 0
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Scrape type for HS17931: 0
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC46871%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Scrape type for YC46871: 2
2026-03-28 05:42:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with identifier: YC46871
2026-03-28 05:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with scrape type 2
2026-03-28 05:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with scrape type 2
2026-03-28 05:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d42e459-4b1a-5f3f-9ccf-efb032914c72, identifier: YC46871
2026-03-28 05:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with identifier: YC46871
2026-03-28 05:42:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with identifier: YC46871
2026-03-28 05:42:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d42e459-4b1a-5f3f-9ccf-efb032914c72 with identifier: YC46871 to the API
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'petrol',
 'id': '5d42e459-4b1a-5f3f-9ccf-efb032914c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC46871',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 45229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC46871%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Saving data for YC46871: {'auction_closing_time': 1774715987.0, 'created_time': 1774467878.587104, 'last_price_update_time': 1774676571.842693}
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC46871') HTTP/1.1" 204 0
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15910%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Scrape type for VZ15910: 0
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU58633%27 HTTP/1.1" 200 None
2026-03-28 05:42:51 [auto1.de] INFO: Scrape type for HU58633: 0
2026-03-28 05:42:51 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for CF91602: 2
2026-03-28 05:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-28 05:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with scrape type 2
2026-03-28 05:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with scrape type 2
2026-03-28 05:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 640ed6bf-5115-501a-a2e8-a88aae1a5d69, identifier: CF91602
2026-03-28 05:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-28 05:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-28 05:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602 to the API
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:01:40Z',
 'fuel_type': 'diesel',
 'id': '640ed6bf-5115-501a-a2e8-a88aae1a5d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF91602',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 165651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-12',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2021}
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Saving data for CF91602: {'auction_closing_time': 1774713700.0, 'created_time': 1774552917.269156, 'last_price_update_time': 1774676572.453369}
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF91602') HTTP/1.1" 204 0
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for YZ29676: 2
2026-03-28 05:42:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-28 05:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64df7030-8269-5525-b33d-5146d2e7c9cd with scrape type 2
2026-03-28 05:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64df7030-8269-5525-b33d-5146d2e7c9cd with scrape type 2
2026-03-28 05:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64df7030-8269-5525-b33d-5146d2e7c9cd, identifier: YZ29676
2026-03-28 05:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-28 05:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-28 05:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676 to the API
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:20:18Z',
 'fuel_type': 'petrol',
 'id': '64df7030-8269-5525-b33d-5146d2e7c9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ29676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 67866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2021}
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Saving data for YZ29676: {'auction_closing_time': 1774714818.0, 'created_time': 1774550938.158475, 'last_price_update_time': 1774676572.91541}
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ29676') HTTP/1.1" 204 0
2026-03-28 05:42:52 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM87026%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for WM87026: 0
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for KF98082: 0
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX41929%27 HTTP/1.1" 200 None
2026-03-28 05:42:52 [auto1.de] INFO: Scrape type for HX41929: 0
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 05:42:52 [auto1.de] INFO: Found listing with ID: YY13895
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: SS50589
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS50589%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for SS50589: 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for JJ00785: 2
2026-03-28 05:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-28 05:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 188ffda1-f7ca-5381-8474-3c171ab099bd with scrape type 2
2026-03-28 05:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 188ffda1-f7ca-5381-8474-3c171ab099bd with scrape type 2
2026-03-28 05:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 188ffda1-f7ca-5381-8474-3c171ab099bd, identifier: JJ00785
2026-03-28 05:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-28 05:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785
2026-03-28 05:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 188ffda1-f7ca-5381-8474-3c171ab099bd with identifier: JJ00785 to the API
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:20:05Z',
 'fuel_type': 'diesel',
 'id': '188ffda1-f7ca-5381-8474-3c171ab099bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ00785',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 227517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Saving data for JJ00785: {'auction_closing_time': 1774714805.0, 'created_time': 1774503335.196333, 'last_price_update_time': 1774676573.495852}
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ00785') HTTP/1.1" 204 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: RC56290
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: XU63236
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX28979%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for DX28979: 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN60731%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for JN60731: 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA89308%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for ZA89308: 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98162%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for ZA98162: 0
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: WS06439
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 05:42:53 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-28 05:42:53 [auto1.de] INFO: Scrape type for JE63209: 2
2026-03-28 05:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-28 05:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd36b3e8-0d41-5176-b245-040b13e484af with scrape type 2
2026-03-28 05:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd36b3e8-0d41-5176-b245-040b13e484af with scrape type 2
2026-03-28 05:42:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd36b3e8-0d41-5176-b245-040b13e484af, identifier: JE63209
2026-03-28 05:42:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-28 05:42:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-28 05:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209 to the API
2026-03-28 05:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:08Z',
 'fuel_type': 'petrol',
 'id': 'cd36b3e8-0d41-5176-b245-040b13e484af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE63209',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 98301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2016}
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Saving data for JE63209: {'auction_closing_time': 1774713728.0, 'created_time': 1774553171.387025, 'last_price_update_time': 1774676574.119942}
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE63209') HTTP/1.1" 204 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH96061%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for CH96061: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC90079%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for VC90079: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR34915%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for XR34915: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for VN57759: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF15161%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for UF15161: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: BD00645
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for SX16558: 2
2026-03-28 05:42:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-28 05:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with scrape type 2
2026-03-28 05:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with scrape type 2
2026-03-28 05:42:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a, identifier: SX16558
2026-03-28 05:42:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-28 05:42:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-28 05:42:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558 to the API
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:01:48Z',
 'fuel_type': 'petrol',
 'id': '4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX16558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Saving data for SX16558: {'auction_closing_time': 1774713708.0, 'created_time': 1774550994.509455, 'last_price_update_time': 1774676574.800255}
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX16558') HTTP/1.1" 204 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: AT89899
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT89899%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for AT89899: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL14548%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for SL14548: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: DG30240
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG30240%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for DG30240: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF64568%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for YF64568: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-28 05:42:54 [auto1.de] INFO: Scrape type for EA07160: 0
2026-03-28 05:42:54 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-28 05:42:55 [auto1.de] INFO: Scrape type for YL11317: 0
2026-03-28 05:42:55 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF45279%27 HTTP/1.1" 200 None
2026-03-28 05:42:55 [auto1.de] INFO: Scrape type for JF45279: 2
2026-03-28 05:42:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2cb00d-9d85-50ea-9384-6412075c7d28 with identifier: JF45279
2026-03-28 05:42:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2cb00d-9d85-50ea-9384-6412075c7d28 with scrape type 2
2026-03-28 05:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c2cb00d-9d85-50ea-9384-6412075c7d28 with scrape type 2
2026-03-28 05:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c2cb00d-9d85-50ea-9384-6412075c7d28, identifier: JF45279
2026-03-28 05:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c2cb00d-9d85-50ea-9384-6412075c7d28 with identifier: JF45279
2026-03-28 05:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c2cb00d-9d85-50ea-9384-6412075c7d28 with identifier: JF45279
2026-03-28 05:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c2cb00d-9d85-50ea-9384-6412075c7d28 with identifier: JF45279 to the API
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:46Z',
 'fuel_type': 'petrol',
 'id': '2c2cb00d-9d85-50ea-9384-6412075c7d28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF45279',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 105266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2016}
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF45279%27 HTTP/1.1" 200 None
2026-03-28 05:42:55 [auto1.de] INFO: Saving data for JF45279: {'auction_closing_time': 1774714426.0, 'created_time': 1774034407.140624, 'last_price_update_time': 1774676575.429019}
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF45279') HTTP/1.1" 204 0
2026-03-28 05:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:56 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Scrape type for CU51755: 0
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM05428%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Scrape type for KM05428: 0
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: TD03088
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW61268%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Scrape type for JW61268: 0
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY86649%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Scrape type for MY86649: 0
2026-03-28 05:42:56 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Scrape type for RG61391: 2
2026-03-28 05:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-28 05:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5063e0d-e5a5-5006-813f-2e566d25a8ef with scrape type 2
2026-03-28 05:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5063e0d-e5a5-5006-813f-2e566d25a8ef with scrape type 2
2026-03-28 05:42:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5063e0d-e5a5-5006-813f-2e566d25a8ef, identifier: RG61391
2026-03-28 05:42:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-28 05:42:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-28 05:42:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391 to the API
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:29:24Z',
 'fuel_type': 'petrol',
 'id': 'a5063e0d-e5a5-5006-813f-2e566d25a8ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG61391',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 148686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-04',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-28 05:42:56 [auto1.de] INFO: Saving data for RG61391: {'auction_closing_time': 1774715364.0, 'created_time': 1774553252.732048, 'last_price_update_time': 1774676576.981707}
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG61391') HTTP/1.1" 204 0
2026-03-28 05:42:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ28815%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for YZ28815: 2
2026-03-28 05:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with identifier: YZ28815
2026-03-28 05:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with scrape type 2
2026-03-28 05:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with scrape type 2
2026-03-28 05:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac, identifier: YZ28815
2026-03-28 05:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with identifier: YZ28815
2026-03-28 05:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with identifier: YZ28815
2026-03-28 05:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac with identifier: YZ28815 to the API
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:16:10Z',
 'fuel_type': 'petrol',
 'id': '25a8d82b-67f4-5b5c-bcc9-9bb7fe02a4ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ28815',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 234972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ28815%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Saving data for YZ28815: {'auction_closing_time': 1774714570.0, 'created_time': 1774467023.097171, 'last_price_update_time': 1774676577.507452}
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ28815') HTTP/1.1" 204 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU07313%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for HU07313: 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ05239%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for MJ05239: 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG37222%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for EG37222: 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG15498%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for LG15498: 0
2026-03-28 05:42:57 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL57176%27 HTTP/1.1" 200 None
2026-03-28 05:42:57 [auto1.de] INFO: Scrape type for TL57176: 2
2026-03-28 05:42:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f235092a-8012-55d3-95c6-e62b49e5df00 with identifier: TL57176
2026-03-28 05:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f235092a-8012-55d3-95c6-e62b49e5df00 with scrape type 2
2026-03-28 05:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f235092a-8012-55d3-95c6-e62b49e5df00 with scrape type 2
2026-03-28 05:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f235092a-8012-55d3-95c6-e62b49e5df00, identifier: TL57176
2026-03-28 05:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f235092a-8012-55d3-95c6-e62b49e5df00 with identifier: TL57176
2026-03-28 05:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f235092a-8012-55d3-95c6-e62b49e5df00 with identifier: TL57176
2026-03-28 05:42:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f235092a-8012-55d3-95c6-e62b49e5df00 with identifier: TL57176 to the API
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': 'f235092a-8012-55d3-95c6-e62b49e5df00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL57176',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 131587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-24',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Cosmo',
 'transmission': 'automatic',
 'trim': 'Cosmo',
 'year': 2009}
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL57176%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Saving data for TL57176: {'auction_closing_time': 1774716173.0, 'created_time': 1774071333.687069, 'last_price_update_time': 1774676578.068881}
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL57176') HTTP/1.1" 204 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45030%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Scrape type for HU45030: 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT53845%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Scrape type for HT53845: 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU78638%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Scrape type for CU78638: 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Scrape type for TS65125: 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Scrape type for EU98670: 2
2026-03-28 05:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-28 05:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c96e10-8a67-542a-8282-70a83a4086fb with scrape type 2
2026-03-28 05:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c96e10-8a67-542a-8282-70a83a4086fb with scrape type 2
2026-03-28 05:42:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c96e10-8a67-542a-8282-70a83a4086fb, identifier: EU98670
2026-03-28 05:42:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-28 05:42:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-28 05:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670 to the API
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'diesel',
 'id': '41c96e10-8a67-542a-8282-70a83a4086fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98670',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 216464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-28 05:42:58 [auto1.de] INFO: Saving data for EU98670: {'auction_closing_time': 1774713887.0, 'created_time': 1774552960.805611, 'last_price_update_time': 1774676578.700139}
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU98670') HTTP/1.1" 204 0
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 05:42:58 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-28 05:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:42:59 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9199 | hits on page: 40
2026-03-28 05:42:59 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 05:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-28 05:42:59 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-28 05:42:59 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 05:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-28 05:42:59 [auto1.de] INFO: Scrape type for YS77012: 2
2026-03-28 05:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-28 05:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with scrape type 2
2026-03-28 05:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with scrape type 2
2026-03-28 05:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab5d826-a08f-55aa-848f-98d38dafa3c8, identifier: YS77012
2026-03-28 05:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-28 05:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-28 05:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012 to the API
2026-03-28 05:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:19:20Z',
 'fuel_type': 'diesel',
 'id': '7ab5d826-a08f-55aa-848f-98d38dafa3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS77012',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 131756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Saving data for YS77012: {'auction_closing_time': 1774714760.0, 'created_time': 1774551998.78811, 'last_price_update_time': 1774676580.201265}
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS77012') HTTP/1.1" 204 0
2026-03-28 05:43:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for ZW18782: 2
2026-03-28 05:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-28 05:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc7479b-88b2-5fbd-baa8-34a371aab012 with scrape type 2
2026-03-28 05:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fc7479b-88b2-5fbd-baa8-34a371aab012 with scrape type 2
2026-03-28 05:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fc7479b-88b2-5fbd-baa8-34a371aab012, identifier: ZW18782
2026-03-28 05:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-28 05:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-28 05:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782 to the API
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': '8fc7479b-88b2-5fbd-baa8-34a371aab012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW18782',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 69765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi TOP Style',
 'transmission': 'manual',
 'trim': 'TOP Style',
 'year': 2018}
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Saving data for ZW18782: {'auction_closing_time': 1774714217.0, 'created_time': 1774552665.208495, 'last_price_update_time': 1774676580.647138}
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW18782') HTTP/1.1" 204 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for DB10875: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: SW52819
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: WK09344
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK14357%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for PK14357: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: BZ18787
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ18787%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for BZ18787: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP42203%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for GP42203: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG24255%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for GG24255: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: GV82392
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV82392%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for GV82392: 0
2026-03-28 05:43:00 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY91371%27 HTTP/1.1" 200 None
2026-03-28 05:43:00 [auto1.de] INFO: Scrape type for MY91371: 2
2026-03-28 05:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 317c8815-1f43-567c-8090-767099a50d3f with identifier: MY91371
2026-03-28 05:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 317c8815-1f43-567c-8090-767099a50d3f with scrape type 2
2026-03-28 05:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 317c8815-1f43-567c-8090-767099a50d3f with scrape type 2
2026-03-28 05:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 317c8815-1f43-567c-8090-767099a50d3f, identifier: MY91371
2026-03-28 05:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 317c8815-1f43-567c-8090-767099a50d3f with identifier: MY91371
2026-03-28 05:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 317c8815-1f43-567c-8090-767099a50d3f with identifier: MY91371
2026-03-28 05:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 317c8815-1f43-567c-8090-767099a50d3f with identifier: MY91371 to the API
2026-03-28 05:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:48:41Z',
 'fuel_type': 'diesel',
 'id': '317c8815-1f43-567c-8090-767099a50d3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY91371',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2010}
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY91371%27 HTTP/1.1" 200 None
2026-03-28 05:43:01 [auto1.de] INFO: Saving data for MY91371: {'auction_closing_time': 1774716521.0, 'created_time': 1774466714.411618, 'last_price_update_time': 1774676581.240256}
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY91371') HTTP/1.1" 204 0
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-28 05:43:01 [auto1.de] INFO: Scrape type for DL82245: 2
2026-03-28 05:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-28 05:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627e8bd3-176a-569e-adbd-787bfe35f41d with scrape type 2
2026-03-28 05:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627e8bd3-176a-569e-adbd-787bfe35f41d with scrape type 2
2026-03-28 05:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 627e8bd3-176a-569e-adbd-787bfe35f41d, identifier: DL82245
2026-03-28 05:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-28 05:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-28 05:43:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245 to the API
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:13:24Z',
 'fuel_type': 'petrol',
 'id': '627e8bd3-176a-569e-adbd-787bfe35f41d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL82245',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 129907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-20',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-28 05:43:01 [auto1.de] INFO: Saving data for DL82245: {'auction_closing_time': 1774714404.0, 'created_time': 1774552872.146059, 'last_price_update_time': 1774676581.811779}
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL82245') HTTP/1.1" 204 0
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM91170%27 HTTP/1.1" 200 None
2026-03-28 05:43:01 [auto1.de] INFO: Scrape type for BM91170: 0
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: PW43450
2026-03-28 05:43:01 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38462%27 HTTP/1.1" 200 None
2026-03-28 05:43:01 [auto1.de] INFO: Scrape type for AA38462: 2
2026-03-28 05:43:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66b268bc-47e6-5744-bf09-5581ed28d6b1 with identifier: AA38462
2026-03-28 05:43:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66b268bc-47e6-5744-bf09-5581ed28d6b1 with scrape type 2
2026-03-28 05:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66b268bc-47e6-5744-bf09-5581ed28d6b1 with scrape type 2
2026-03-28 05:43:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66b268bc-47e6-5744-bf09-5581ed28d6b1, identifier: AA38462
2026-03-28 05:43:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66b268bc-47e6-5744-bf09-5581ed28d6b1 with identifier: AA38462
2026-03-28 05:43:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66b268bc-47e6-5744-bf09-5581ed28d6b1 with identifier: AA38462
2026-03-28 05:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66b268bc-47e6-5744-bf09-5581ed28d6b1 with identifier: AA38462 to the API
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:04:21Z',
 'fuel_type': 'petrol',
 'id': '66b268bc-47e6-5744-bf09-5581ed28d6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA38462',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 67658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2015}
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38462%27 HTTP/1.1" 200 None
2026-03-28 05:43:02 [auto1.de] INFO: Saving data for AA38462: {'auction_closing_time': 1774713861.0, 'created_time': 1774468281.228802, 'last_price_update_time': 1774676582.283008}
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA38462') HTTP/1.1" 204 0
2026-03-28 05:43:02 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ59540%27 HTTP/1.1" 200 None
2026-03-28 05:43:02 [auto1.de] INFO: Scrape type for TZ59540: 0
2026-03-28 05:43:02 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-28 05:43:02 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP61181%27 HTTP/1.1" 200 None
2026-03-28 05:43:02 [auto1.de] INFO: Scrape type for SP61181: 2
2026-03-28 05:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-03-28 05:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with scrape type 2
2026-03-28 05:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with scrape type 2
2026-03-28 05:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e, identifier: SP61181
2026-03-28 05:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-03-28 05:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181
2026-03-28 05:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8c20637-56ae-5ad1-ac6b-b8cd76300d6e with identifier: SP61181 to the API
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:15:07Z',
 'fuel_type': 'petrol',
 'id': 'f8c20637-56ae-5ad1-ac6b-b8cd76300d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP61181',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 162964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP61181%27 HTTP/1.1" 200 None
2026-03-28 05:43:02 [auto1.de] INFO: Saving data for SP61181: {'auction_closing_time': 1774714507.0, 'created_time': 1774464077.226236, 'last_price_update_time': 1774676582.749085}
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP61181') HTTP/1.1" 204 0
2026-03-28 05:43:02 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG71684%27 HTTP/1.1" 200 None
2026-03-28 05:43:02 [auto1.de] INFO: Scrape type for NG71684: 2
2026-03-28 05:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d885563-3105-5957-a49c-fe2555106f52 with identifier: NG71684
2026-03-28 05:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d885563-3105-5957-a49c-fe2555106f52 with scrape type 2
2026-03-28 05:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d885563-3105-5957-a49c-fe2555106f52 with scrape type 2
2026-03-28 05:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d885563-3105-5957-a49c-fe2555106f52, identifier: NG71684
2026-03-28 05:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d885563-3105-5957-a49c-fe2555106f52 with identifier: NG71684
2026-03-28 05:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d885563-3105-5957-a49c-fe2555106f52 with identifier: NG71684
2026-03-28 05:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d885563-3105-5957-a49c-fe2555106f52 with identifier: NG71684 to the API
2026-03-28 05:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:43Z',
 'fuel_type': 'diesel',
 'id': '3d885563-3105-5957-a49c-fe2555106f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG71684',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 200518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2012}
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG71684%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Saving data for NG71684: {'auction_closing_time': 1774714903.0, 'created_time': 1774467489.052776, 'last_price_update_time': 1774676583.188654}
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG71684') HTTP/1.1" 204 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: CA26393
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26393%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for CA26393: 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for YL01247: 2
2026-03-28 05:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-28 05:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with scrape type 2
2026-03-28 05:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with scrape type 2
2026-03-28 05:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52, identifier: YL01247
2026-03-28 05:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-28 05:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-28 05:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247 to the API
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'petrol',
 'id': '9f9e0ad3-b70a-5368-9856-91d8d02b6f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL01247',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 23034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2025}
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Saving data for YL01247: {'auction_closing_time': 1774714694.0, 'created_time': 1774552813.241819, 'last_price_update_time': 1774676583.850141}
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL01247') HTTP/1.1" 204 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: RZ83508
2026-03-28 05:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:03 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-28 05:43:03 [auto1.de] INFO: Scrape type for ZW60338: 0
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 05:43:03 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL58365%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for ZL58365: 0
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for LS75303: 0
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: CH57776
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH57776%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for CH57776: 0
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE89354%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for SE89354: 2
2026-03-28 05:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with identifier: SE89354
2026-03-28 05:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with scrape type 2
2026-03-28 05:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with scrape type 2
2026-03-28 05:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b, identifier: SE89354
2026-03-28 05:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with identifier: SE89354
2026-03-28 05:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with identifier: SE89354
2026-03-28 05:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dd7853d-9b7d-50c8-bdef-893b8cf5f84b with identifier: SE89354 to the API
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:08:25Z',
 'fuel_type': 'diesel',
 'id': '0dd7853d-9b7d-50c8-bdef-893b8cf5f84b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE89354',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 185507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE89354%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Saving data for SE89354: {'auction_closing_time': 1774714105.0, 'created_time': 1774466234.386503, 'last_price_update_time': 1774676584.490468}
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE89354') HTTP/1.1" 204 0
2026-03-28 05:43:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH51774%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for FH51774: 0
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-28 05:43:04 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-28 05:43:04 [auto1.de] INFO: Scrape type for XH15947: 2
2026-03-28 05:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-28 05:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57b086c-6eb5-5f59-b454-f87ef085272b with scrape type 2
2026-03-28 05:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57b086c-6eb5-5f59-b454-f87ef085272b with scrape type 2
2026-03-28 05:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f57b086c-6eb5-5f59-b454-f87ef085272b, identifier: XH15947
2026-03-28 05:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-28 05:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-28 05:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947 to the API
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:39Z',
 'fuel_type': 'petrol',
 'id': 'f57b086c-6eb5-5f59-b454-f87ef085272b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH15947',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 166786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-25',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Saving data for XH15947: {'auction_closing_time': 1774715139.0, 'created_time': 1774552660.213232, 'last_price_update_time': 1774676585.068953}
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH15947') HTTP/1.1" 204 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: ZZ35874
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ35874%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for ZZ35874: 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK74975%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for TK74975: 2
2026-03-28 05:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa08fa2d-1067-5c11-87b7-f05c86c163a0 with identifier: TK74975
2026-03-28 05:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa08fa2d-1067-5c11-87b7-f05c86c163a0 with scrape type 2
2026-03-28 05:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa08fa2d-1067-5c11-87b7-f05c86c163a0 with scrape type 2
2026-03-28 05:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa08fa2d-1067-5c11-87b7-f05c86c163a0, identifier: TK74975
2026-03-28 05:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa08fa2d-1067-5c11-87b7-f05c86c163a0 with identifier: TK74975
2026-03-28 05:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa08fa2d-1067-5c11-87b7-f05c86c163a0 with identifier: TK74975
2026-03-28 05:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa08fa2d-1067-5c11-87b7-f05c86c163a0 with identifier: TK74975 to the API
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:22:51Z',
 'fuel_type': 'petrol',
 'id': 'aa08fa2d-1067-5c11-87b7-f05c86c163a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK74975',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 92183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-23',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK74975%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Saving data for TK74975: {'auction_closing_time': 1774714971.0, 'created_time': 1774466773.670625, 'last_price_update_time': 1774676585.556166}
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK74975') HTTP/1.1" 204 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: VH79690
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41474%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for CE41474: 0
2026-03-28 05:43:05 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-28 05:43:05 [auto1.de] INFO: Scrape type for UA25868: 2
2026-03-28 05:43:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-28 05:43:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6654d5-1e7c-55da-9895-1e45d0796f4a with scrape type 2
2026-03-28 05:43:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be6654d5-1e7c-55da-9895-1e45d0796f4a with scrape type 2
2026-03-28 05:43:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be6654d5-1e7c-55da-9895-1e45d0796f4a, identifier: UA25868
2026-03-28 05:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-28 05:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-28 05:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868 to the API
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:46:53Z',
 'fuel_type': 'petrol',
 'id': 'be6654d5-1e7c-55da-9895-1e45d0796f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA25868',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 145055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2013}
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Saving data for UA25868: {'auction_closing_time': 1774716413.0, 'created_time': 1774553082.473147, 'last_price_update_time': 1774676586.04133}
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA25868') HTTP/1.1" 204 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: DD25870
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD25870%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for DD25870: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for ZJ06184: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: TA27217
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA27217%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for TA27217: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: AR87733
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87733%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for AR87733: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA68941%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for VA68941: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN95746%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for DN95746: 2
2026-03-28 05:43:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5cd6a8b-d428-5e46-843f-25546daf27d5 with identifier: DN95746
2026-03-28 05:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5cd6a8b-d428-5e46-843f-25546daf27d5 with scrape type 2
2026-03-28 05:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5cd6a8b-d428-5e46-843f-25546daf27d5 with scrape type 2
2026-03-28 05:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5cd6a8b-d428-5e46-843f-25546daf27d5, identifier: DN95746
2026-03-28 05:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5cd6a8b-d428-5e46-843f-25546daf27d5 with identifier: DN95746
2026-03-28 05:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5cd6a8b-d428-5e46-843f-25546daf27d5 with identifier: DN95746
2026-03-28 05:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5cd6a8b-d428-5e46-843f-25546daf27d5 with identifier: DN95746 to the API
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:30:59Z',
 'fuel_type': 'diesel',
 'id': 'b5cd6a8b-d428-5e46-843f-25546daf27d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN95746',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 164309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-23',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN95746%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Saving data for DN95746: {'auction_closing_time': 1774715459.0, 'created_time': 1774466573.077988, 'last_price_update_time': 1774676586.644919}
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN95746') HTTP/1.1" 204 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for GX07003: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS28124%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for VS28124: 0
2026-03-28 05:43:06 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-28 05:43:06 [auto1.de] INFO: Scrape type for PF14640: 0
2026-03-28 05:43:06 [scrapy.extensions.logstats] INFO: Crawled 150 pages (at 16 pages/min), scraped 591 items (at 87 items/min)
2026-03-28 05:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:07 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:07 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-28 05:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL70534%27 HTTP/1.1" 200 None
2026-03-28 05:43:07 [auto1.de] INFO: Scrape type for GL70534: 0
2026-03-28 05:43:07 [auto1.de] INFO: Found listing with ID: CH21169
2026-03-28 05:43:07 [auto1.de] INFO: Found listing with ID: KA16702
2026-03-28 05:43:07 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-28 05:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU48969%27 HTTP/1.1" 200 None
2026-03-28 05:43:07 [auto1.de] INFO: Scrape type for UU48969: 2
2026-03-28 05:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8402726c-26d2-5dcb-a26a-66c369584196 with identifier: UU48969
2026-03-28 05:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8402726c-26d2-5dcb-a26a-66c369584196 with scrape type 2
2026-03-28 05:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8402726c-26d2-5dcb-a26a-66c369584196 with scrape type 2
2026-03-28 05:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8402726c-26d2-5dcb-a26a-66c369584196, identifier: UU48969
2026-03-28 05:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8402726c-26d2-5dcb-a26a-66c369584196 with identifier: UU48969
2026-03-28 05:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8402726c-26d2-5dcb-a26a-66c369584196 with identifier: UU48969
2026-03-28 05:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8402726c-26d2-5dcb-a26a-66c369584196 with identifier: UU48969 to the API
2026-03-28 05:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:46Z',
 'fuel_type': 'diesel',
 'id': '8402726c-26d2-5dcb-a26a-66c369584196',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU48969',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 155579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-04',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2015}
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU48969%27 HTTP/1.1" 200 None
2026-03-28 05:43:08 [auto1.de] INFO: Saving data for UU48969: {'auction_closing_time': 1774714006.0, 'created_time': 1773831068.326011, 'last_price_update_time': 1774676588.170745}
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU48969') HTTP/1.1" 204 0
2026-03-28 05:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-28 05:43:08 [auto1.de] INFO: Scrape type for BY37084: 2
2026-03-28 05:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-28 05:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7e4f64-5f67-5844-b0b9-febe0688e47e with scrape type 2
2026-03-28 05:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c7e4f64-5f67-5844-b0b9-febe0688e47e with scrape type 2
2026-03-28 05:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c7e4f64-5f67-5844-b0b9-febe0688e47e, identifier: BY37084
2026-03-28 05:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-28 05:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-28 05:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084 to the API
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 86,
 'expiration_date': '2026-03-28T16:07:03Z',
 'fuel_type': 'petrol',
 'id': '4c7e4f64-5f67-5844-b0b9-febe0688e47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY37084',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 188002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 MPI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2011}
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-28 05:43:08 [auto1.de] INFO: Saving data for BY37084: {'auction_closing_time': 1774714023.0, 'created_time': 1773306598.592792, 'last_price_update_time': 1774676588.734385}
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY37084') HTTP/1.1" 204 0
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 05:43:08 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-28 05:43:08 [auto1.de] INFO: Scrape type for ST87748: 2
2026-03-28 05:43:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-28 05:43:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with scrape type 2
2026-03-28 05:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with scrape type 2
2026-03-28 05:43:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a, identifier: ST87748
2026-03-28 05:43:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-28 05:43:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-28 05:43:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748 to the API
2026-03-28 05:43:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:57Z',
 'fuel_type': 'diesel',
 'id': '6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST87748',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 96570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten EcoProfi',
 'transmission': 'automatic',
 'trim': 'Kasten EcoProfi',
 'year': 2019}
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Saving data for ST87748: {'auction_closing_time': 1774716477.0, 'created_time': 1774552741.369987, 'last_price_update_time': 1774676589.174543}
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST87748') HTTP/1.1" 204 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: UU77813
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU77813%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for UU77813: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for MG81975: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58189%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for RT58189: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for UM54862: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD53184%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for HD53184: 2
2026-03-28 05:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e90eeee8-cea2-5010-952f-11ac1e3de04e with identifier: HD53184
2026-03-28 05:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e90eeee8-cea2-5010-952f-11ac1e3de04e with scrape type 2
2026-03-28 05:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e90eeee8-cea2-5010-952f-11ac1e3de04e with scrape type 2
2026-03-28 05:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e90eeee8-cea2-5010-952f-11ac1e3de04e, identifier: HD53184
2026-03-28 05:43:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e90eeee8-cea2-5010-952f-11ac1e3de04e with identifier: HD53184
2026-03-28 05:43:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e90eeee8-cea2-5010-952f-11ac1e3de04e with identifier: HD53184
2026-03-28 05:43:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e90eeee8-cea2-5010-952f-11ac1e3de04e with identifier: HD53184 to the API
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:03:50Z',
 'fuel_type': 'petrol',
 'id': 'e90eeee8-cea2-5010-952f-11ac1e3de04e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD53184',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 40790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-04',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2018}
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD53184%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Saving data for HD53184: {'auction_closing_time': 1774713830.0, 'created_time': 1773861694.75741, 'last_price_update_time': 1774676589.794669}
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD53184') HTTP/1.1" 204 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY59187%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for ZY59187: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for TV16338: 0
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-28 05:43:09 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-28 05:43:09 [auto1.de] INFO: Scrape type for HA14963: 2
2026-03-28 05:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-28 05:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33aecad7-344f-520d-b2c6-d160220dad37 with scrape type 2
2026-03-28 05:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33aecad7-344f-520d-b2c6-d160220dad37 with scrape type 2
2026-03-28 05:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33aecad7-344f-520d-b2c6-d160220dad37, identifier: HA14963
2026-03-28 05:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-28 05:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-28 05:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963 to the API
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:30:47Z',
 'fuel_type': 'petrol',
 'id': '33aecad7-344f-520d-b2c6-d160220dad37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA14963',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 82254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-28 05:43:10 [auto1.de] INFO: Saving data for HA14963: {'auction_closing_time': 1774715447.0, 'created_time': 1774552681.494288, 'last_price_update_time': 1774676590.320917}
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA14963') HTTP/1.1" 204 0
2026-03-28 05:43:10 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-28 05:43:10 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-28 05:43:10 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL68502%27 HTTP/1.1" 200 None
2026-03-28 05:43:10 [auto1.de] INFO: Scrape type for HL68502: 2
2026-03-28 05:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32ddd704-344e-55fd-ba79-55e75be2cadc with identifier: HL68502
2026-03-28 05:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32ddd704-344e-55fd-ba79-55e75be2cadc with scrape type 2
2026-03-28 05:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32ddd704-344e-55fd-ba79-55e75be2cadc with scrape type 2
2026-03-28 05:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32ddd704-344e-55fd-ba79-55e75be2cadc, identifier: HL68502
2026-03-28 05:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32ddd704-344e-55fd-ba79-55e75be2cadc with identifier: HL68502
2026-03-28 05:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32ddd704-344e-55fd-ba79-55e75be2cadc with identifier: HL68502
2026-03-28 05:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32ddd704-344e-55fd-ba79-55e75be2cadc with identifier: HL68502 to the API
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:56Z',
 'fuel_type': 'diesel',
 'id': '32ddd704-344e-55fd-ba79-55e75be2cadc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL68502',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 221556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL68502%27 HTTP/1.1" 200 None
2026-03-28 05:43:10 [auto1.de] INFO: Saving data for HL68502: {'auction_closing_time': 1774715216.0, 'created_time': 1774466980.210027, 'last_price_update_time': 1774676590.871749}
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL68502') HTTP/1.1" 204 0
2026-03-28 05:43:10 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS10993%27 HTTP/1.1" 200 None
2026-03-28 05:43:10 [auto1.de] INFO: Scrape type for FS10993: 2
2026-03-28 05:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c9850bd-4a7f-5973-8247-1ce6e378b341 with identifier: FS10993
2026-03-28 05:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c9850bd-4a7f-5973-8247-1ce6e378b341 with scrape type 2
2026-03-28 05:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c9850bd-4a7f-5973-8247-1ce6e378b341 with scrape type 2
2026-03-28 05:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c9850bd-4a7f-5973-8247-1ce6e378b341, identifier: FS10993
2026-03-28 05:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c9850bd-4a7f-5973-8247-1ce6e378b341 with identifier: FS10993
2026-03-28 05:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c9850bd-4a7f-5973-8247-1ce6e378b341 with identifier: FS10993
2026-03-28 05:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c9850bd-4a7f-5973-8247-1ce6e378b341 with identifier: FS10993 to the API
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:02:09Z',
 'fuel_type': 'diesel',
 'id': '5c9850bd-4a7f-5973-8247-1ce6e378b341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS10993',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 19799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-19',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
 'transmission': 'automatic',
 'trim': 'Wildtrak e-4WD Doppelkabine',
 'year': 2025}
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS10993%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Saving data for FS10993: {'auction_closing_time': 1774713729.0, 'created_time': 1774467451.440415, 'last_price_update_time': 1774676591.322353}
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS10993') HTTP/1.1" 204 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY94514%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for DY94514: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-28 05:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:11 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for HN88809: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for TX80950: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: BK51387
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK51387%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for BK51387: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: HV36396
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: MR55647
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: ET88076
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET88076%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for ET88076: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: ZF79989
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: MY79031
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79031%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for MY79031: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-28 05:43:11 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Scrape type for VM82441: 2
2026-03-28 05:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-28 05:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with scrape type 2
2026-03-28 05:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with scrape type 2
2026-03-28 05:43:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd, identifier: VM82441
2026-03-28 05:43:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-28 05:43:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-28 05:43:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441 to the API
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:48:08Z',
 'fuel_type': 'petrol',
 'id': 'e0bd1825-3bc3-5f42-b51b-e78dce8db0dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM82441',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 37901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-28 05:43:11 [auto1.de] INFO: Saving data for VM82441: {'auction_closing_time': 1774716488.0, 'created_time': 1774552140.071294, 'last_price_update_time': 1774676591.999654}
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM82441') HTTP/1.1" 204 0
2026-03-28 05:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF42462%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for LF42462: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for BP69696: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for SP94156: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF24039%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for TF24039: 2
2026-03-28 05:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-03-28 05:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c with scrape type 2
2026-03-28 05:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a4d6143-d4e6-584b-b42f-08b6db2a674c with scrape type 2
2026-03-28 05:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a4d6143-d4e6-584b-b42f-08b6db2a674c, identifier: TF24039
2026-03-28 05:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-03-28 05:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039
2026-03-28 05:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a4d6143-d4e6-584b-b42f-08b6db2a674c with identifier: TF24039 to the API
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:15:49Z',
 'fuel_type': 'petrol',
 'id': '1a4d6143-d4e6-584b-b42f-08b6db2a674c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF24039',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 51885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF24039%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Saving data for TF24039: {'auction_closing_time': 1774714549.0, 'created_time': 1774464358.18179, 'last_price_update_time': 1774676592.593485}
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF24039') HTTP/1.1" 204 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04688%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for HH04688: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV58210%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for JV58210: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK28209%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for AK28209: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL68511%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for SL68511: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: PM76396
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM76396%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for PM76396: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN06461%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for PN06461: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: YR27652
2026-03-28 05:43:12 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP16305%27 HTTP/1.1" 200 None
2026-03-28 05:43:12 [auto1.de] INFO: Scrape type for WP16305: 2
2026-03-28 05:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with identifier: WP16305
2026-03-28 05:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with scrape type 2
2026-03-28 05:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with scrape type 2
2026-03-28 05:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed90be56-ea6b-5bca-ac7d-1a8d4448b65c, identifier: WP16305
2026-03-28 05:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with identifier: WP16305
2026-03-28 05:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with identifier: WP16305
2026-03-28 05:43:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed90be56-ea6b-5bca-ac7d-1a8d4448b65c with identifier: WP16305 to the API
2026-03-28 05:43:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:46Z',
 'fuel_type': 'petrol',
 'id': 'ed90be56-ea6b-5bca-ac7d-1a8d4448b65c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP16305',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 26295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP16305%27 HTTP/1.1" 200 None
2026-03-28 05:43:13 [auto1.de] INFO: Saving data for WP16305: {'auction_closing_time': 1774714906.0, 'created_time': 1774464023.833426, 'last_price_update_time': 1774676593.157766}
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP16305') HTTP/1.1" 204 0
2026-03-28 05:43:13 [auto1.de] INFO: Found listing with ID: KW34660
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34660%27 HTTP/1.1" 200 None
2026-03-28 05:43:13 [auto1.de] INFO: Scrape type for KW34660: 0
2026-03-28 05:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:14 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC21551%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for KC21551: 0
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN24576%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for XN24576: 2
2026-03-28 05:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with identifier: XN24576
2026-03-28 05:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with scrape type 2
2026-03-28 05:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with scrape type 2
2026-03-28 05:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2cf928b-1aa4-5976-b2bf-6f4e58bd4997, identifier: XN24576
2026-03-28 05:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with identifier: XN24576
2026-03-28 05:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with identifier: XN24576
2026-03-28 05:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2cf928b-1aa4-5976-b2bf-6f4e58bd4997 with identifier: XN24576 to the API
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:28:30Z',
 'fuel_type': 'petrol',
 'id': 'e2cf928b-1aa4-5976-b2bf-6f4e58bd4997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN24576',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 20984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2022}
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN24576%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Saving data for XN24576: {'auction_closing_time': 1774715310.0, 'created_time': 1774467205.162272, 'last_price_update_time': 1774676594.670054}
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN24576') HTTP/1.1" 204 0
2026-03-28 05:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: GE52020
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for CM78973: 0
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for MV77064: 0
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for EM22494: 0
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-28 05:43:14 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-28 05:43:14 [auto1.de] INFO: Scrape type for YJ21750: 2
2026-03-28 05:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-28 05:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf41e13-4d20-5a91-a4da-40c1321618cf with scrape type 2
2026-03-28 05:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf41e13-4d20-5a91-a4da-40c1321618cf with scrape type 2
2026-03-28 05:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acf41e13-4d20-5a91-a4da-40c1321618cf, identifier: YJ21750
2026-03-28 05:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-28 05:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-28 05:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750 to the API
2026-03-28 05:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'diesel',
 'id': 'acf41e13-4d20-5a91-a4da-40c1321618cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 184161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Exclusive BlueMotion',
 'transmission': 'manual',
 'trim': 'Exclusive BlueMotion',
 'year': 2012}
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Saving data for YJ21750: {'auction_closing_time': 1774714893.0, 'created_time': 1774552958.195043, 'last_price_update_time': 1774676595.179938}
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ21750') HTTP/1.1" 204 0
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE48983%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Scrape type for XE48983: 2
2026-03-28 05:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with identifier: XE48983
2026-03-28 05:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with scrape type 2
2026-03-28 05:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with scrape type 2
2026-03-28 05:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12339a85-8e8b-5044-b0ba-1b6383ecfe3c, identifier: XE48983
2026-03-28 05:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with identifier: XE48983
2026-03-28 05:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with identifier: XE48983
2026-03-28 05:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12339a85-8e8b-5044-b0ba-1b6383ecfe3c with identifier: XE48983 to the API
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:08:38Z',
 'fuel_type': 'petrol',
 'id': '12339a85-8e8b-5044-b0ba-1b6383ecfe3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE48983',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 179468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-08',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE48983%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Saving data for XE48983: {'auction_closing_time': 1774714118.0, 'created_time': 1774467986.41775, 'last_price_update_time': 1774676595.722901}
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE48983') HTTP/1.1" 204 0
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: AT80326
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT80326%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Scrape type for AT80326: 0
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY74539%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Scrape type for PY74539: 0
2026-03-28 05:43:15 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR20309%27 HTTP/1.1" 200 None
2026-03-28 05:43:15 [auto1.de] INFO: Scrape type for NR20309: 2
2026-03-28 05:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a86e39f6-32dd-5163-855a-8726d946491e with identifier: NR20309
2026-03-28 05:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a86e39f6-32dd-5163-855a-8726d946491e with scrape type 2
2026-03-28 05:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a86e39f6-32dd-5163-855a-8726d946491e with scrape type 2
2026-03-28 05:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a86e39f6-32dd-5163-855a-8726d946491e, identifier: NR20309
2026-03-28 05:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a86e39f6-32dd-5163-855a-8726d946491e with identifier: NR20309
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:43:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 05:43:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a86e39f6-32dd-5163-855a-8726d946491e with identifier: NR20309
2026-03-28 05:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a86e39f6-32dd-5163-855a-8726d946491e with identifier: NR20309 to the API
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:13:31Z',
 'fuel_type': 'petrol',
 'id': 'a86e39f6-32dd-5163-855a-8726d946491e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR20309',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 172963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-20',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2016}
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR20309%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Saving data for NR20309: {'auction_closing_time': 1774714411.0, 'created_time': 1774466677.561861, 'last_price_update_time': 1774676596.319524}
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR20309') HTTP/1.1" 204 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for MN42254: 2
2026-03-28 05:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-28 05:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with scrape type 2
2026-03-28 05:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with scrape type 2
2026-03-28 05:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8, identifier: MN42254
2026-03-28 05:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-28 05:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-28 05:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254 to the API
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:59:12Z',
 'fuel_type': 'petrol',
 'id': '9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN42254',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 47387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Saving data for MN42254: {'auction_closing_time': 1774717152.0, 'created_time': 1774553085.533316, 'last_price_update_time': 1774676596.786865}
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN42254') HTTP/1.1" 204 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB81192%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for VB81192: 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: DC41283
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM54247%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for AM54247: 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: DT97256
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE84221%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for BE84221: 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for PC67993: 0
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 05:43:16 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86078%27 HTTP/1.1" 200 None
2026-03-28 05:43:16 [auto1.de] INFO: Scrape type for WR86078: 2
2026-03-28 05:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with identifier: WR86078
2026-03-28 05:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with scrape type 2
2026-03-28 05:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with scrape type 2
2026-03-28 05:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b, identifier: WR86078
2026-03-28 05:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with identifier: WR86078
2026-03-28 05:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with identifier: WR86078
2026-03-28 05:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b with identifier: WR86078 to the API
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:29:31Z',
 'fuel_type': 'petrol',
 'id': '44ed6ff9-31ef-53ee-ac48-cb51bd69ec2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR86078',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 80524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI S Line',
 'transmission': 'manual',
 'trim': 'S Line',
 'year': 2020}
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86078%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Saving data for WR86078: {'auction_closing_time': 1774715371.0, 'created_time': 1774503340.756064, 'last_price_update_time': 1774676597.328869}
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR86078') HTTP/1.1" 204 0
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR83365%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Scrape type for YR83365: 0
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM86665%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Scrape type for AM86665: 0
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Scrape type for KL68094: 0
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Scrape type for CC57472: 2
2026-03-28 05:43:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-28 05:43:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5164ab3d-e632-583f-8bd0-dfbd53336dfc with scrape type 2
2026-03-28 05:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5164ab3d-e632-583f-8bd0-dfbd53336dfc with scrape type 2
2026-03-28 05:43:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5164ab3d-e632-583f-8bd0-dfbd53336dfc, identifier: CC57472
2026-03-28 05:43:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-28 05:43:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-28 05:43:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472 to the API
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:49:49Z',
 'fuel_type': 'diesel',
 'id': '5164ab3d-e632-583f-8bd0-dfbd53336dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC57472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 114533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2013}
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-28 05:43:17 [auto1.de] INFO: Saving data for CC57472: {'auction_closing_time': 1774716589.0, 'created_time': 1774552896.480804, 'last_price_update_time': 1774676597.897636}
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC57472') HTTP/1.1" 204 0
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: SP65010
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: VB40979
2026-03-28 05:43:17 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 05:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:18 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT42679%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Scrape type for FT42679: 0
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Scrape type for ZA60248: 0
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79964%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Scrape type for JR79964: 2
2026-03-28 05:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0d473f-f9a6-51bc-9b8c-98abb00e121e with identifier: JR79964
2026-03-28 05:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0d473f-f9a6-51bc-9b8c-98abb00e121e with scrape type 2
2026-03-28 05:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb0d473f-f9a6-51bc-9b8c-98abb00e121e with scrape type 2
2026-03-28 05:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb0d473f-f9a6-51bc-9b8c-98abb00e121e, identifier: JR79964
2026-03-28 05:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb0d473f-f9a6-51bc-9b8c-98abb00e121e with identifier: JR79964
2026-03-28 05:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb0d473f-f9a6-51bc-9b8c-98abb00e121e with identifier: JR79964
2026-03-28 05:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb0d473f-f9a6-51bc-9b8c-98abb00e121e with identifier: JR79964 to the API
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:08Z',
 'fuel_type': 'diesel',
 'id': 'fb0d473f-f9a6-51bc-9b8c-98abb00e121e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR79964',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 209266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79964%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Saving data for JR79964: {'auction_closing_time': 1774715468.0, 'created_time': 1774467545.725992, 'last_price_update_time': 1774676598.481878}
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR79964') HTTP/1.1" 204 0
2026-03-28 05:43:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: KP25975
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Scrape type for HJ76482: 0
2026-03-28 05:43:18 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-28 05:43:18 [auto1.de] INFO: Scrape type for BJ31953: 2
2026-03-28 05:43:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-28 05:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bdcb7e-33e1-5949-b51c-976356011629 with scrape type 2
2026-03-28 05:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94bdcb7e-33e1-5949-b51c-976356011629 with scrape type 2
2026-03-28 05:43:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94bdcb7e-33e1-5949-b51c-976356011629, identifier: BJ31953
2026-03-28 05:43:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-28 05:43:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-28 05:43:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953 to the API
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:46:43Z',
 'fuel_type': 'diesel',
 'id': '94bdcb7e-33e1-5949-b51c-976356011629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ31953',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 79378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-13',
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition XL erhöhte Nutzlast',
 'transmission': 'manual',
 'trim': 'Edition XL erhöhte Nutzlast',
 'year': 2019}
2026-03-28 05:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Saving data for BJ31953: {'auction_closing_time': 1774716403.0, 'created_time': 1774552495.707403, 'last_price_update_time': 1774676599.007893}
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ31953') HTTP/1.1" 204 0
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB02253%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Scrape type for KB02253: 2
2026-03-28 05:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84d735b-08ac-5271-ac28-882f1c60be55 with identifier: KB02253
2026-03-28 05:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84d735b-08ac-5271-ac28-882f1c60be55 with scrape type 2
2026-03-28 05:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84d735b-08ac-5271-ac28-882f1c60be55 with scrape type 2
2026-03-28 05:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84d735b-08ac-5271-ac28-882f1c60be55, identifier: KB02253
2026-03-28 05:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84d735b-08ac-5271-ac28-882f1c60be55 with identifier: KB02253
2026-03-28 05:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84d735b-08ac-5271-ac28-882f1c60be55 with identifier: KB02253
2026-03-28 05:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84d735b-08ac-5271-ac28-882f1c60be55 with identifier: KB02253 to the API
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:17:13Z',
 'fuel_type': 'hybrid',
 'id': 'd84d735b-08ac-5271-ac28-882f1c60be55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB02253',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 45874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Recharge Plug-in Hybrid Inscription Expression '
          '2WD',
 'transmission': 'automatic',
 'trim': 'Inscription Expression 2WD',
 'year': 2021}
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB02253%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Saving data for KB02253: {'auction_closing_time': 1774714633.0, 'created_time': 1774466879.965408, 'last_price_update_time': 1774676599.456702}
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB02253') HTTP/1.1" 204 0
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ32938%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Scrape type for ZJ32938: 0
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 05:43:19 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57867%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Scrape type for AY57867: 2
2026-03-28 05:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with identifier: AY57867
2026-03-28 05:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with scrape type 2
2026-03-28 05:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with scrape type 2
2026-03-28 05:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e, identifier: AY57867
2026-03-28 05:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with identifier: AY57867
2026-03-28 05:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with identifier: AY57867
2026-03-28 05:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e with identifier: AY57867 to the API
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:12:23Z',
 'fuel_type': 'petrol',
 'id': '59013c0c-1af4-5ba6-9e2d-d8773a7b3a0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY57867',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 118759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-01',
 'seller_name': None,
 'title': 'MINI One First',
 'transmission': 'manual',
 'trim': 'First',
 'year': 2017}
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57867%27 HTTP/1.1" 200 None
2026-03-28 05:43:19 [auto1.de] INFO: Saving data for AY57867: {'auction_closing_time': 1774714343.0, 'created_time': 1774466403.9276, 'last_price_update_time': 1774676599.927257}
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY57867') HTTP/1.1" 204 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Scrape type for AR60138: 2
2026-03-28 05:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-28 05:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc2e9241-efe3-5c3b-aac9-6dd193077e01 with scrape type 2
2026-03-28 05:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc2e9241-efe3-5c3b-aac9-6dd193077e01 with scrape type 2
2026-03-28 05:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc2e9241-efe3-5c3b-aac9-6dd193077e01, identifier: AR60138
2026-03-28 05:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-28 05:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-28 05:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138 to the API
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'petrol',
 'id': 'cc2e9241-efe3-5c3b-aac9-6dd193077e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR60138',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 83003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Renault Clio 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2012}
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Saving data for AR60138: {'auction_closing_time': 1774715302.0, 'created_time': 1774553046.597611, 'last_price_update_time': 1774676600.483592}
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR60138') HTTP/1.1" 204 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: VR22354
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR22354%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Scrape type for VR22354: 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18146%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Scrape type for BS18146: 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Scrape type for GR91976: 2
2026-03-28 05:43:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-28 05:43:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e043504-cb86-5c3e-8cde-bd489b356113 with scrape type 2
2026-03-28 05:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e043504-cb86-5c3e-8cde-bd489b356113 with scrape type 2
2026-03-28 05:43:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e043504-cb86-5c3e-8cde-bd489b356113, identifier: GR91976
2026-03-28 05:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-28 05:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-28 05:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976 to the API
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:41Z',
 'fuel_type': 'diesel',
 'id': '0e043504-cb86-5c3e-8cde-bd489b356113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR91976',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 196320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Highline 4Motion',
 'transmission': 'manual',
 'trim': 'Highline 4Motion',
 'year': 2012}
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Saving data for GR91976: {'auction_closing_time': 1774715501.0, 'created_time': 1774552906.465086, 'last_price_update_time': 1774676600.9574}
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR91976') HTTP/1.1" 204 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-28 05:43:20 [auto1.de] INFO: Scrape type for HC32133: 0
2026-03-28 05:43:20 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG31378%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for TG31378: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for RZ07739: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for UJ91538: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ76479%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for CJ76479: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: LS64729
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for LD99689: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47458%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for AM47458: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14643%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for WF14643: 2
2026-03-28 05:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5838fd9-de02-533a-a17c-84a70efa4a18 with identifier: WF14643
2026-03-28 05:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5838fd9-de02-533a-a17c-84a70efa4a18 with scrape type 2
2026-03-28 05:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5838fd9-de02-533a-a17c-84a70efa4a18 with scrape type 2
2026-03-28 05:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5838fd9-de02-533a-a17c-84a70efa4a18, identifier: WF14643
2026-03-28 05:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5838fd9-de02-533a-a17c-84a70efa4a18 with identifier: WF14643
2026-03-28 05:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5838fd9-de02-533a-a17c-84a70efa4a18 with identifier: WF14643
2026-03-28 05:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5838fd9-de02-533a-a17c-84a70efa4a18 with identifier: WF14643 to the API
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:45:56Z',
 'fuel_type': 'petrol',
 'id': 'd5838fd9-de02-533a-a17c-84a70efa4a18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF14643',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 73521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-26',
 'seller_name': None,
 'title': 'Smart forfour 0.9 Turbo Brabus Brabus',
 'transmission': 'automatic',
 'trim': 'Brabus Brabus',
 'year': 2018}
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14643%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Saving data for WF14643: {'auction_closing_time': 1774716356.0, 'created_time': 1774464102.272546, 'last_price_update_time': 1774676601.567404}
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF14643') HTTP/1.1" 204 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE81350%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for FE81350: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC31076%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for EC31076: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28173%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for ZF28173: 0
2026-03-28 05:43:21 [auto1.de] INFO: Found listing with ID: DX07392
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX07392%27 HTTP/1.1" 200 None
2026-03-28 05:43:21 [auto1.de] INFO: Scrape type for DX07392: 0
2026-03-28 05:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:22 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: JZ39033
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ39033%27 HTTP/1.1" 200 None
2026-03-28 05:43:22 [auto1.de] INFO: Scrape type for JZ39033: 0
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-28 05:43:22 [auto1.de] INFO: Scrape type for AE82588: 0
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC16779%27 HTTP/1.1" 200 None
2026-03-28 05:43:22 [auto1.de] INFO: Scrape type for TC16779: 0
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-28 05:43:22 [auto1.de] INFO: Scrape type for NH05952: 0
2026-03-28 05:43:22 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL22285%27 HTTP/1.1" 200 None
2026-03-28 05:43:22 [auto1.de] INFO: Scrape type for PL22285: 2
2026-03-28 05:43:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a860c1c-8922-5591-9956-53e4bc8cbe4e with identifier: PL22285
2026-03-28 05:43:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a860c1c-8922-5591-9956-53e4bc8cbe4e with scrape type 2
2026-03-28 05:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a860c1c-8922-5591-9956-53e4bc8cbe4e with scrape type 2
2026-03-28 05:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a860c1c-8922-5591-9956-53e4bc8cbe4e, identifier: PL22285
2026-03-28 05:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a860c1c-8922-5591-9956-53e4bc8cbe4e with identifier: PL22285
2026-03-28 05:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a860c1c-8922-5591-9956-53e4bc8cbe4e with identifier: PL22285
2026-03-28 05:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a860c1c-8922-5591-9956-53e4bc8cbe4e with identifier: PL22285 to the API
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:27Z',
 'fuel_type': 'diesel',
 'id': '3a860c1c-8922-5591-9956-53e4bc8cbe4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL22285',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 156795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2017}
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL22285%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Saving data for PL22285: {'auction_closing_time': 1774714587.0, 'created_time': 1774465955.196412, 'last_price_update_time': 1774676603.060037}
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL22285') HTTP/1.1" 204 0
2026-03-28 05:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC99377%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for ZC99377: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98765%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for ZH98765: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: UJ86189
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ86189%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for UJ86189: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: KX31285
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for YH32466: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM05155%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for TM05155: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for SH34786: 2
2026-03-28 05:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-28 05:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with scrape type 2
2026-03-28 05:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with scrape type 2
2026-03-28 05:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed, identifier: SH34786
2026-03-28 05:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-28 05:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-28 05:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786 to the API
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:49Z',
 'fuel_type': 'diesel',
 'id': 'a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH34786',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 194837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Saving data for SH34786: {'auction_closing_time': 1774715509.0, 'created_time': 1774553051.766648, 'last_price_update_time': 1774676603.704456}
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH34786') HTTP/1.1" 204 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: GD63015
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN07258%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for SN07258: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE56791%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for PE56791: 0
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-28 05:43:23 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-28 05:43:23 [auto1.de] INFO: Scrape type for ZY67116: 2
2026-03-28 05:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-28 05:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51776a69-ef28-5800-a63e-84bde599a898 with scrape type 2
2026-03-28 05:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51776a69-ef28-5800-a63e-84bde599a898 with scrape type 2
2026-03-28 05:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51776a69-ef28-5800-a63e-84bde599a898, identifier: ZY67116
2026-03-28 05:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-28 05:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-28 05:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116 to the API
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'petrol',
 'id': '51776a69-ef28-5800-a63e-84bde599a898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY67116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 72324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-28 05:43:24 [auto1.de] INFO: Saving data for ZY67116: {'auction_closing_time': 1774713982.0, 'created_time': 1774553225.853692, 'last_price_update_time': 1774676604.287783}
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY67116') HTTP/1.1" 204 0
2026-03-28 05:43:24 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-28 05:43:24 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ61618%27 HTTP/1.1" 200 None
2026-03-28 05:43:24 [auto1.de] INFO: Scrape type for UJ61618: 2
2026-03-28 05:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02864983-1fe3-580e-aa32-b86b5b6a25f7 with identifier: UJ61618
2026-03-28 05:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02864983-1fe3-580e-aa32-b86b5b6a25f7 with scrape type 2
2026-03-28 05:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02864983-1fe3-580e-aa32-b86b5b6a25f7 with scrape type 2
2026-03-28 05:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02864983-1fe3-580e-aa32-b86b5b6a25f7, identifier: UJ61618
2026-03-28 05:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02864983-1fe3-580e-aa32-b86b5b6a25f7 with identifier: UJ61618
2026-03-28 05:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02864983-1fe3-580e-aa32-b86b5b6a25f7 with identifier: UJ61618
2026-03-28 05:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02864983-1fe3-580e-aa32-b86b5b6a25f7 with identifier: UJ61618 to the API
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:38Z',
 'fuel_type': 'petrol',
 'id': '02864983-1fe3-580e-aa32-b86b5b6a25f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ61618',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 67962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ61618%27 HTTP/1.1" 200 None
2026-03-28 05:43:24 [auto1.de] INFO: Saving data for UJ61618: {'auction_closing_time': 1774716038.0, 'created_time': 1774468261.049954, 'last_price_update_time': 1774676604.833246}
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ61618') HTTP/1.1" 204 0
2026-03-28 05:43:24 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ79831%27 HTTP/1.1" 200 None
2026-03-28 05:43:24 [auto1.de] INFO: Scrape type for CZ79831: 0
2026-03-28 05:43:24 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-28 05:43:24 [auto1.de] INFO: Scrape type for NP30819: 2
2026-03-28 05:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-28 05:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with scrape type 2
2026-03-28 05:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with scrape type 2
2026-03-28 05:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c, identifier: NP30819
2026-03-28 05:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-28 05:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-28 05:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819 to the API
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:00:33Z',
 'fuel_type': 'petrol',
 'id': 'd8cec16a-0eaa-5568-a7b3-c88b3b0bd42c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP30819',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-28 05:43:25 [auto1.de] INFO: Saving data for NP30819: {'auction_closing_time': 1774713633.0, 'created_time': 1774551848.120793, 'last_price_update_time': 1774676605.286002}
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP30819') HTTP/1.1" 204 0
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11397%27 HTTP/1.1" 200 None
2026-03-28 05:43:25 [auto1.de] INFO: Scrape type for SA11397: 0
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY48646%27 HTTP/1.1" 200 None
2026-03-28 05:43:25 [auto1.de] INFO: Scrape type for UY48646: 0
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-28 05:43:25 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-28 05:43:25 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-28 05:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:26 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for VY63466: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for UP16968: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ87403%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for JZ87403: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: LR63660
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for FV55966: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31526%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for SY31526: 2
2026-03-28 05:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with identifier: SY31526
2026-03-28 05:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with scrape type 2
2026-03-28 05:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with scrape type 2
2026-03-28 05:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cf347c2-45f4-5c12-8e62-0d3f407eafe4, identifier: SY31526
2026-03-28 05:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with identifier: SY31526
2026-03-28 05:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with identifier: SY31526
2026-03-28 05:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cf347c2-45f4-5c12-8e62-0d3f407eafe4 with identifier: SY31526 to the API
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:54:09Z',
 'fuel_type': 'diesel',
 'id': '9cf347c2-45f4-5c12-8e62-0d3f407eafe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY31526',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 218833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-23',
 'seller_name': None,
 'title': 'Seat Leon 1.9 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2006}
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31526%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Saving data for SY31526: {'auction_closing_time': 1774716849.0, 'created_time': 1774467816.751173, 'last_price_update_time': 1774676606.551953}
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY31526') HTTP/1.1" 204 0
2026-03-28 05:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: MF84483
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF84483%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for MF84483: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-28 05:43:26 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09833%27 HTTP/1.1" 200 None
2026-03-28 05:43:26 [auto1.de] INFO: Scrape type for GF09833: 2
2026-03-28 05:43:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c9553d1-9928-597d-b973-ab4396f9d259 with identifier: GF09833
2026-03-28 05:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9553d1-9928-597d-b973-ab4396f9d259 with scrape type 2
2026-03-28 05:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c9553d1-9928-597d-b973-ab4396f9d259 with scrape type 2
2026-03-28 05:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c9553d1-9928-597d-b973-ab4396f9d259, identifier: GF09833
2026-03-28 05:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c9553d1-9928-597d-b973-ab4396f9d259 with identifier: GF09833
2026-03-28 05:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c9553d1-9928-597d-b973-ab4396f9d259 with identifier: GF09833
2026-03-28 05:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c9553d1-9928-597d-b973-ab4396f9d259 with identifier: GF09833 to the API
2026-03-28 05:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:46:54Z',
 'fuel_type': 'diesel',
 'id': '6c9553d1-9928-597d-b973-ab4396f9d259',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF09833',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 252960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09833%27 HTTP/1.1" 200 None
2026-03-28 05:43:27 [auto1.de] INFO: Saving data for GF09833: {'auction_closing_time': 1774716414.0, 'created_time': 1774466911.676502, 'last_price_update_time': 1774676607.126276}
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF09833') HTTP/1.1" 204 0
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN43536%27 HTTP/1.1" 200 None
2026-03-28 05:43:27 [auto1.de] INFO: Scrape type for JN43536: 0
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK72065%27 HTTP/1.1" 200 None
2026-03-28 05:43:27 [auto1.de] INFO: Scrape type for WK72065: 2
2026-03-28 05:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdab0d1-547b-5a83-83a4-1d34458bc5da with identifier: WK72065
2026-03-28 05:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdab0d1-547b-5a83-83a4-1d34458bc5da with scrape type 2
2026-03-28 05:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbdab0d1-547b-5a83-83a4-1d34458bc5da with scrape type 2
2026-03-28 05:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbdab0d1-547b-5a83-83a4-1d34458bc5da, identifier: WK72065
2026-03-28 05:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbdab0d1-547b-5a83-83a4-1d34458bc5da with identifier: WK72065
2026-03-28 05:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbdab0d1-547b-5a83-83a4-1d34458bc5da with identifier: WK72065
2026-03-28 05:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbdab0d1-547b-5a83-83a4-1d34458bc5da with identifier: WK72065 to the API
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:21Z',
 'fuel_type': 'petrol',
 'id': 'fbdab0d1-547b-5a83-83a4-1d34458bc5da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK72065',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 158289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-09-07',
 'seller_name': None,
 'title': 'Audi A3 1.8 Turbo Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 1999}
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK72065%27 HTTP/1.1" 200 None
2026-03-28 05:43:27 [auto1.de] INFO: Saving data for WK72065: {'auction_closing_time': 1774713801.0, 'created_time': 1774034522.220697, 'last_price_update_time': 1774676607.593399}
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK72065') HTTP/1.1" 204 0
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: HX62286
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-28 05:43:27 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF28588%27 HTTP/1.1" 200 None
2026-03-28 05:43:27 [auto1.de] INFO: Scrape type for MF28588: 2
2026-03-28 05:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with identifier: MF28588
2026-03-28 05:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with scrape type 2
2026-03-28 05:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with scrape type 2
2026-03-28 05:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4ec1df3-8614-5f34-9b2f-6a0b4f79c294, identifier: MF28588
2026-03-28 05:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with identifier: MF28588
2026-03-28 05:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with identifier: MF28588
2026-03-28 05:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4ec1df3-8614-5f34-9b2f-6a0b4f79c294 with identifier: MF28588 to the API
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:16:26Z',
 'fuel_type': 'hybrid',
 'id': 'c4ec1df3-8614-5f34-9b2f-6a0b4f79c294',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF28588',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 186228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2020}
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF28588%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Saving data for MF28588: {'auction_closing_time': 1774714586.0, 'created_time': 1774464386.949027, 'last_price_update_time': 1774676608.035596}
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF28588') HTTP/1.1" 204 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37320%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for MR37320: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: JS52679
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: PL74690
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL74690%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for PL74690: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: GD45566
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD45566%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for GD45566: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: WJ71939
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for ZW96632: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: UK33964
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN22906%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for AN22906: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13733%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for ZY13733: 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Scrape type for PA77354: 2
2026-03-28 05:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-28 05:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc96ba6-ba3d-5607-ba97-394886380936 with scrape type 2
2026-03-28 05:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc96ba6-ba3d-5607-ba97-394886380936 with scrape type 2
2026-03-28 05:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fc96ba6-ba3d-5607-ba97-394886380936, identifier: PA77354
2026-03-28 05:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-28 05:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-28 05:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354 to the API
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:37:48Z',
 'fuel_type': 'diesel',
 'id': '0fc96ba6-ba3d-5607-ba97-394886380936',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA77354',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 235848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-28 05:43:28 [auto1.de] INFO: Saving data for PA77354: {'auction_closing_time': 1774715868.0, 'created_time': 1774553206.36597, 'last_price_update_time': 1774676608.686467}
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA77354') HTTP/1.1" 204 0
2026-03-28 05:43:28 [auto1.de] INFO: Found listing with ID: YM61958
2026-03-28 05:43:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:29 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:29 [auto1.de] INFO: Found listing with ID: DX36556
2026-03-28 05:43:29 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 05:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB12464%27 HTTP/1.1" 200 None
2026-03-28 05:43:29 [auto1.de] INFO: Scrape type for RB12464: 2
2026-03-28 05:43:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2616717c-2ab7-537e-829c-3778d7a57408 with identifier: RB12464
2026-03-28 05:43:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2616717c-2ab7-537e-829c-3778d7a57408 with scrape type 2
2026-03-28 05:43:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2616717c-2ab7-537e-829c-3778d7a57408 with scrape type 2
2026-03-28 05:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2616717c-2ab7-537e-829c-3778d7a57408, identifier: RB12464
2026-03-28 05:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2616717c-2ab7-537e-829c-3778d7a57408 with identifier: RB12464
2026-03-28 05:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2616717c-2ab7-537e-829c-3778d7a57408 with identifier: RB12464
2026-03-28 05:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2616717c-2ab7-537e-829c-3778d7a57408 with identifier: RB12464 to the API
2026-03-28 05:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:01Z',
 'fuel_type': 'diesel',
 'id': '2616717c-2ab7-537e-829c-3778d7a57408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB12464',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 338654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-24',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB12464%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Saving data for RB12464: {'auction_closing_time': 1774715041.0, 'created_time': 1774464199.618866, 'last_price_update_time': 1774676610.139782}
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB12464') HTTP/1.1" 204 0
2026-03-28 05:43:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: BX80092
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX80092%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for BX80092: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP30788%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for AP30788: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for AD16750: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for KN60852: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96858%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for VB96858: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH63993%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for UH63993: 2
2026-03-28 05:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c11269-d580-568f-8850-c9ad33c2d2ac with identifier: UH63993
2026-03-28 05:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c11269-d580-568f-8850-c9ad33c2d2ac with scrape type 2
2026-03-28 05:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90c11269-d580-568f-8850-c9ad33c2d2ac with scrape type 2
2026-03-28 05:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90c11269-d580-568f-8850-c9ad33c2d2ac, identifier: UH63993
2026-03-28 05:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90c11269-d580-568f-8850-c9ad33c2d2ac with identifier: UH63993
2026-03-28 05:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90c11269-d580-568f-8850-c9ad33c2d2ac with identifier: UH63993
2026-03-28 05:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90c11269-d580-568f-8850-c9ad33c2d2ac with identifier: UH63993 to the API
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:33Z',
 'fuel_type': 'petrol',
 'id': '90c11269-d580-568f-8850-c9ad33c2d2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH63993',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 211496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-06',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2007}
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH63993%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Saving data for UH63993: {'auction_closing_time': 1774714473.0, 'created_time': 1774467741.803459, 'last_price_update_time': 1774676610.737448}
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH63993') HTTP/1.1" 204 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for XY85080: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW32080%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for AW32080: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for PP42616: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for LZ76677: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for YJ21289: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: MA95783
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: KZ31354
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ31354%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for KZ31354: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: EW67341
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-28 05:43:30 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-28 05:43:30 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 05:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-28 05:43:31 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-28 05:43:31 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR13539%27 HTTP/1.1" 200 None
2026-03-28 05:43:31 [auto1.de] INFO: Scrape type for KR13539: 0
2026-03-28 05:43:31 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ75594%27 HTTP/1.1" 200 None
2026-03-28 05:43:31 [auto1.de] INFO: Scrape type for WJ75594: 2
2026-03-28 05:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c491c59c-8bdc-58a7-8e87-68e8242b298d with identifier: WJ75594
2026-03-28 05:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c491c59c-8bdc-58a7-8e87-68e8242b298d with scrape type 2
2026-03-28 05:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c491c59c-8bdc-58a7-8e87-68e8242b298d with scrape type 2
2026-03-28 05:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c491c59c-8bdc-58a7-8e87-68e8242b298d, identifier: WJ75594
2026-03-28 05:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c491c59c-8bdc-58a7-8e87-68e8242b298d with identifier: WJ75594
2026-03-28 05:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c491c59c-8bdc-58a7-8e87-68e8242b298d with identifier: WJ75594
2026-03-28 05:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c491c59c-8bdc-58a7-8e87-68e8242b298d with identifier: WJ75594 to the API
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'petrol',
 'id': 'c491c59c-8bdc-58a7-8e87-68e8242b298d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ75594',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 48661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ75594%27 HTTP/1.1" 200 None
2026-03-28 05:43:31 [auto1.de] INFO: Saving data for WJ75594: {'auction_closing_time': 1774715778.0, 'created_time': 1774464065.948542, 'last_price_update_time': 1774676611.88017}
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ75594') HTTP/1.1" 204 0
2026-03-28 05:43:31 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-28 05:43:31 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 05:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-28 05:43:32 [auto1.de] INFO: Scrape type for SM94434: 2
2026-03-28 05:43:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-28 05:43:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b76b8503-5aca-5ccc-a53b-4dacce421ba4 with scrape type 2
2026-03-28 05:43:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b76b8503-5aca-5ccc-a53b-4dacce421ba4 with scrape type 2
2026-03-28 05:43:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b76b8503-5aca-5ccc-a53b-4dacce421ba4, identifier: SM94434
2026-03-28 05:43:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-28 05:43:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-28 05:43:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434 to the API
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:27:31Z',
 'fuel_type': 'petrol',
 'id': 'b76b8503-5aca-5ccc-a53b-4dacce421ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM94434',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-28 05:43:32 [auto1.de] INFO: Saving data for SM94434: {'auction_closing_time': 1774715251.0, 'created_time': 1774552973.481352, 'last_price_update_time': 1774676612.41055}
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM94434') HTTP/1.1" 204 0
2026-03-28 05:43:32 [auto1.de] INFO: Found listing with ID: AJ01843
2026-03-28 05:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:33 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: PY95410
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY95410%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for PY95410: 0
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT92200%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for RT92200: 0
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: XF50561
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF50561%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for XF50561: 0
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72646%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Scrape type for BM72646: 2
2026-03-28 05:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98777115-ee05-5288-aace-87d94041c1e5 with identifier: BM72646
2026-03-28 05:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98777115-ee05-5288-aace-87d94041c1e5 with scrape type 2
2026-03-28 05:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98777115-ee05-5288-aace-87d94041c1e5 with scrape type 2
2026-03-28 05:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98777115-ee05-5288-aace-87d94041c1e5, identifier: BM72646
2026-03-28 05:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98777115-ee05-5288-aace-87d94041c1e5 with identifier: BM72646
2026-03-28 05:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98777115-ee05-5288-aace-87d94041c1e5 with identifier: BM72646
2026-03-28 05:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98777115-ee05-5288-aace-87d94041c1e5 with identifier: BM72646 to the API
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:02Z',
 'fuel_type': 'diesel',
 'id': '98777115-ee05-5288-aace-87d94041c1e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM72646',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 193612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72646%27 HTTP/1.1" 200 None
2026-03-28 05:43:33 [auto1.de] INFO: Saving data for BM72646: {'auction_closing_time': 1774714502.0, 'created_time': 1774467985.561705, 'last_price_update_time': 1774676613.873119}
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM72646') HTTP/1.1" 204 0
2026-03-28 05:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: JW05714
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: JE98088
2026-03-28 05:43:33 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 05:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC69607%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for UC69607: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN12831%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for AN12831: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: XE96364
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE96364%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for XE96364: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG57535%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for FG57535: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN29704%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for GN29704: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: WH80890
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH80890%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for WH80890: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for KZ71348: 2
2026-03-28 05:43:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-28 05:43:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with scrape type 2
2026-03-28 05:43:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with scrape type 2
2026-03-28 05:43:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da, identifier: KZ71348
2026-03-28 05:43:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-28 05:43:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-28 05:43:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348 to the API
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:40:36Z',
 'fuel_type': 'petrol',
 'id': 'a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ71348',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 37912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Saving data for KZ71348: {'auction_closing_time': 1774716036.0, 'created_time': 1774552725.550776, 'last_price_update_time': 1774676614.64469}
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ71348') HTTP/1.1" 204 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW43695%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for ZW43695: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for DY62455: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for ZC46474: 0
2026-03-28 05:43:34 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-28 05:43:34 [auto1.de] INFO: Scrape type for FH83727: 0
2026-03-28 05:43:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:35 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-28 05:43:35 [auto1.de] INFO: Scrape type for XR30933: 0
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU42762%27 HTTP/1.1" 200 None
2026-03-28 05:43:35 [auto1.de] INFO: Scrape type for FU42762: 0
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55491%27 HTTP/1.1" 200 None
2026-03-28 05:43:35 [auto1.de] INFO: Scrape type for NV55491: 0
2026-03-28 05:43:35 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF52750%27 HTTP/1.1" 200 None
2026-03-28 05:43:35 [auto1.de] INFO: Scrape type for YF52750: 2
2026-03-28 05:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with identifier: YF52750
2026-03-28 05:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with scrape type 2
2026-03-28 05:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with scrape type 2
2026-03-28 05:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977, identifier: YF52750
2026-03-28 05:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with identifier: YF52750
2026-03-28 05:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with identifier: YF52750
2026-03-28 05:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977 with identifier: YF52750 to the API
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'diesel',
 'id': 'ef8275a6-dd1c-5e69-8ce4-3b1fa2acc977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF52750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 106332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF52750%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Saving data for YF52750: {'auction_closing_time': 1774715130.0, 'created_time': 1774503341.707096, 'last_price_update_time': 1774676616.274022}
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF52750') HTTP/1.1" 204 0
2026-03-28 05:43:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: HX03519
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX03519%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for HX03519: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS62719%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for MS62719: 2
2026-03-28 05:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with identifier: MS62719
2026-03-28 05:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with scrape type 2
2026-03-28 05:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with scrape type 2
2026-03-28 05:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc5f54bd-332e-5174-9bd7-d01d1a6e60fb, identifier: MS62719
2026-03-28 05:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with identifier: MS62719
2026-03-28 05:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with identifier: MS62719
2026-03-28 05:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc5f54bd-332e-5174-9bd7-d01d1a6e60fb with identifier: MS62719 to the API
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:29:50Z',
 'fuel_type': 'petrol',
 'id': 'cc5f54bd-332e-5174-9bd7-d01d1a6e60fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS62719',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 67395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-10',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2021}
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS62719%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Saving data for MS62719: {'auction_closing_time': 1774715390.0, 'created_time': 1774465933.625645, 'last_price_update_time': 1774676616.84382}
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS62719') HTTP/1.1" 204 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for TB37654: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR27484%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for JR27484: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX94695%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for EX94695: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN20097%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for PN20097: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: LY36770
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36770%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for LY36770: 0
2026-03-28 05:43:36 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41685%27 HTTP/1.1" 200 None
2026-03-28 05:43:36 [auto1.de] INFO: Scrape type for KS41685: 2
2026-03-28 05:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dbc919c-6fd4-56d8-a739-8450dad47e3d with identifier: KS41685
2026-03-28 05:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dbc919c-6fd4-56d8-a739-8450dad47e3d with scrape type 2
2026-03-28 05:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dbc919c-6fd4-56d8-a739-8450dad47e3d with scrape type 2
2026-03-28 05:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1dbc919c-6fd4-56d8-a739-8450dad47e3d, identifier: KS41685
2026-03-28 05:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1dbc919c-6fd4-56d8-a739-8450dad47e3d with identifier: KS41685
2026-03-28 05:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1dbc919c-6fd4-56d8-a739-8450dad47e3d with identifier: KS41685
2026-03-28 05:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1dbc919c-6fd4-56d8-a739-8450dad47e3d with identifier: KS41685 to the API
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:06:03Z',
 'fuel_type': 'petrol',
 'id': '1dbc919c-6fd4-56d8-a739-8450dad47e3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS41685',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 178619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-23',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2015}
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41685%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Saving data for KS41685: {'auction_closing_time': 1774713963.0, 'created_time': 1774464415.557223, 'last_price_update_time': 1774676617.363103}
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS41685') HTTP/1.1" 204 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Scrape type for EC36111: 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: DR00758
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK53444%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Scrape type for XK53444: 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: ZK88504
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB87978%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Scrape type for UB87978: 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00237%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Scrape type for WC00237: 2
2026-03-28 05:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7284998a-07c3-590b-8619-72ecc8af33c8 with identifier: WC00237
2026-03-28 05:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7284998a-07c3-590b-8619-72ecc8af33c8 with scrape type 2
2026-03-28 05:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7284998a-07c3-590b-8619-72ecc8af33c8 with scrape type 2
2026-03-28 05:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7284998a-07c3-590b-8619-72ecc8af33c8, identifier: WC00237
2026-03-28 05:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7284998a-07c3-590b-8619-72ecc8af33c8 with identifier: WC00237
2026-03-28 05:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7284998a-07c3-590b-8619-72ecc8af33c8 with identifier: WC00237
2026-03-28 05:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7284998a-07c3-590b-8619-72ecc8af33c8 with identifier: WC00237 to the API
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:39Z',
 'fuel_type': 'petrol',
 'id': '7284998a-07c3-590b-8619-72ecc8af33c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC00237',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 113644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-23',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
 'transmission': 'automatic',
 'trim': 'ACT',
 'year': 2020}
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00237%27 HTTP/1.1" 200 None
2026-03-28 05:43:37 [auto1.de] INFO: Saving data for WC00237: {'auction_closing_time': 1774715679.0, 'created_time': 1774463789.792475, 'last_price_update_time': 1774676617.976497}
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC00237') HTTP/1.1" 204 0
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-28 05:43:37 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 05:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-28 05:43:38 [auto1.de] INFO: Scrape type for YF79248: 2
2026-03-28 05:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-28 05:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with scrape type 2
2026-03-28 05:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with scrape type 2
2026-03-28 05:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4, identifier: YF79248
2026-03-28 05:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-28 05:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-28 05:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248 to the API
2026-03-28 05:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:05Z',
 'fuel_type': 'diesel',
 'id': 'bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF79248',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 272250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-23',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-28 05:43:39 [auto1.de] INFO: Saving data for YF79248: {'auction_closing_time': 1774714145.0, 'created_time': 1774552818.262669, 'last_price_update_time': 1774676619.35073}
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF79248') HTTP/1.1" 204 0
2026-03-28 05:43:39 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 05:43:39 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-28 05:43:39 [auto1.de] INFO: Scrape type for MC25913: 2
2026-03-28 05:43:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-28 05:43:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa62ea0-5b54-506e-a89a-9a6b30978451 with scrape type 2
2026-03-28 05:43:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa62ea0-5b54-506e-a89a-9a6b30978451 with scrape type 2
2026-03-28 05:43:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fa62ea0-5b54-506e-a89a-9a6b30978451, identifier: MC25913
2026-03-28 05:43:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-28 05:43:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-28 05:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913 to the API
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:02:44Z',
 'fuel_type': 'diesel',
 'id': '6fa62ea0-5b54-506e-a89a-9a6b30978451',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC25913',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 149649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Avantgarde Edition',
 'year': 2019}
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-28 05:43:39 [auto1.de] INFO: Saving data for MC25913: {'auction_closing_time': 1774713764.0, 'created_time': 1774552850.693101, 'last_price_update_time': 1774676619.874766}
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC25913') HTTP/1.1" 204 0
2026-03-28 05:43:39 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-28 05:43:39 [auto1.de] INFO: Found listing with ID: KS63717
2026-03-28 05:43:39 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT98608%27 HTTP/1.1" 200 None
2026-03-28 05:43:39 [auto1.de] INFO: Scrape type for FT98608: 0
2026-03-28 05:43:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:40 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: GA14949
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: JG20363
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU10771%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for NU10771: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX08468%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for DX08468: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: XK58974
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK58974%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for XK58974: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38290%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for BV38290: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for XV42513: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP39358%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for DP39358: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49576%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for RT49576: 2
2026-03-28 05:43:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f078108-3632-509b-998d-a1a8789b5280 with identifier: RT49576
2026-03-28 05:43:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f078108-3632-509b-998d-a1a8789b5280 with scrape type 2
2026-03-28 05:43:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f078108-3632-509b-998d-a1a8789b5280 with scrape type 2
2026-03-28 05:43:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f078108-3632-509b-998d-a1a8789b5280, identifier: RT49576
2026-03-28 05:43:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f078108-3632-509b-998d-a1a8789b5280 with identifier: RT49576
2026-03-28 05:43:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f078108-3632-509b-998d-a1a8789b5280 with identifier: RT49576
2026-03-28 05:43:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f078108-3632-509b-998d-a1a8789b5280 with identifier: RT49576 to the API
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:41Z',
 'fuel_type': 'petrol',
 'id': '1f078108-3632-509b-998d-a1a8789b5280',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT49576',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 19534,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-19',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2024}
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49576%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Saving data for RT49576: {'auction_closing_time': 1774716641.0, 'created_time': 1774466792.214505, 'last_price_update_time': 1774676620.848313}
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT49576') HTTP/1.1" 204 0
2026-03-28 05:43:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-28 05:43:40 [auto1.de] INFO: Scrape type for KT21278: 0
2026-03-28 05:43:40 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-28 05:43:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX30612%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Scrape type for GX30612: 0
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66360%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Scrape type for WV66360: 2
2026-03-28 05:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with identifier: WV66360
2026-03-28 05:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with scrape type 2
2026-03-28 05:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with scrape type 2
2026-03-28 05:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da178e94-6002-5d1e-8e2c-bb77e45bc8d7, identifier: WV66360
2026-03-28 05:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with identifier: WV66360
2026-03-28 05:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with identifier: WV66360
2026-03-28 05:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da178e94-6002-5d1e-8e2c-bb77e45bc8d7 with identifier: WV66360 to the API
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:16Z',
 'fuel_type': 'petrol',
 'id': 'da178e94-6002-5d1e-8e2c-bb77e45bc8d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV66360',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 131541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66360%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Saving data for WV66360: {'auction_closing_time': 1774715476.0, 'created_time': 1774466983.831482, 'last_price_update_time': 1774676621.45983}
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV66360') HTTP/1.1" 204 0
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Scrape type for HP20518: 0
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-28 05:43:41 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Scrape type for ZM65960: 2
2026-03-28 05:43:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-28 05:43:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b89a15-4d0c-530a-8004-226f9414d7de with scrape type 2
2026-03-28 05:43:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b89a15-4d0c-530a-8004-226f9414d7de with scrape type 2
2026-03-28 05:43:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b89a15-4d0c-530a-8004-226f9414d7de, identifier: ZM65960
2026-03-28 05:43:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-28 05:43:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-28 05:43:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960 to the API
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:27:59Z',
 'fuel_type': 'petrol',
 'id': '71b89a15-4d0c-530a-8004-226f9414d7de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM65960',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 142011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2017}
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-28 05:43:41 [auto1.de] INFO: Saving data for ZM65960: {'auction_closing_time': 1774715279.0, 'created_time': 1773916631.939725, 'last_price_update_time': 1774676621.929892}
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM65960') HTTP/1.1" 204 0
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: WW30672
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV13376%27 HTTP/1.1" 200 None
2026-03-28 05:43:42 [auto1.de] INFO: Scrape type for YV13376: 0
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: NR78945
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR78945%27 HTTP/1.1" 200 None
2026-03-28 05:43:42 [auto1.de] INFO: Scrape type for NR78945: 0
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: NC53020
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF56080%27 HTTP/1.1" 200 None
2026-03-28 05:43:42 [auto1.de] INFO: Scrape type for TF56080: 2
2026-03-28 05:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d97ca23-dc55-59e9-a307-258d3a8da854 with identifier: TF56080
2026-03-28 05:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d97ca23-dc55-59e9-a307-258d3a8da854 with scrape type 2
2026-03-28 05:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d97ca23-dc55-59e9-a307-258d3a8da854 with scrape type 2
2026-03-28 05:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d97ca23-dc55-59e9-a307-258d3a8da854, identifier: TF56080
2026-03-28 05:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d97ca23-dc55-59e9-a307-258d3a8da854 with identifier: TF56080
2026-03-28 05:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d97ca23-dc55-59e9-a307-258d3a8da854 with identifier: TF56080
2026-03-28 05:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d97ca23-dc55-59e9-a307-258d3a8da854 with identifier: TF56080 to the API
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:53Z',
 'fuel_type': 'petrol',
 'id': '7d97ca23-dc55-59e9-a307-258d3a8da854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF56080',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 18972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-23',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2023}
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF56080%27 HTTP/1.1" 200 None
2026-03-28 05:43:42 [auto1.de] INFO: Saving data for TF56080: {'auction_closing_time': 1774715873.0, 'created_time': 1774467660.505447, 'last_price_update_time': 1774676622.533759}
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF56080') HTTP/1.1" 204 0
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 05:43:42 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-28 05:43:42 [auto1.de] INFO: Scrape type for DB69488: 2
2026-03-28 05:43:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-28 05:43:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with scrape type 2
2026-03-28 05:43:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with scrape type 2
2026-03-28 05:43:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c, identifier: DB69488
2026-03-28 05:43:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-28 05:43:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-28 05:43:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488 to the API
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:02:42Z',
 'fuel_type': 'petrol',
 'id': 'd9b6ea1b-ce44-5a65-9b13-9fcddf65c36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB69488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 25507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-28 05:43:43 [auto1.de] INFO: Saving data for DB69488: {'auction_closing_time': 1774713762.0, 'created_time': 1774553084.797057, 'last_price_update_time': 1774676623.055897}
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB69488') HTTP/1.1" 204 0
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-28 05:43:43 [auto1.de] INFO: Scrape type for CL04690: 0
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-28 05:43:43 [auto1.de] INFO: Scrape type for YF83541: 0
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: AW34840
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 05:43:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:43 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:43 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-28 05:43:43 [auto1.de] INFO: Scrape type for EB43981: 2
2026-03-28 05:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-28 05:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with scrape type 2
2026-03-28 05:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with scrape type 2
2026-03-28 05:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7, identifier: EB43981
2026-03-28 05:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-28 05:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-28 05:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981 to the API
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:18Z',
 'fuel_type': 'petrol',
 'id': 'e88b6e7a-a610-5d9e-8a9a-e1c67b385af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB43981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 67187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Saving data for EB43981: {'auction_closing_time': 1774714338.0, 'created_time': 1774552752.436605, 'last_price_update_time': 1774676624.336284}
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB43981') HTTP/1.1" 204 0
2026-03-28 05:43:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for AM22108: 2
2026-03-28 05:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-28 05:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b120a1-1224-5c23-8b72-67be568f1c46 with scrape type 2
2026-03-28 05:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b120a1-1224-5c23-8b72-67be568f1c46 with scrape type 2
2026-03-28 05:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70b120a1-1224-5c23-8b72-67be568f1c46, identifier: AM22108
2026-03-28 05:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-28 05:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-28 05:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108 to the API
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:38:09Z',
 'fuel_type': 'petrol',
 'id': '70b120a1-1224-5c23-8b72-67be568f1c46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM22108',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 148191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Saving data for AM22108: {'auction_closing_time': 1774715889.0, 'created_time': 1774552727.615727, 'last_price_update_time': 1774676624.865297}
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM22108') HTTP/1.1" 204 0
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF37634%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for YF37634: 0
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: XE27570
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for VZ67143: 0
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for PY29315: 0
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX10510%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for HX10510: 0
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-28 05:43:44 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-28 05:43:44 [auto1.de] INFO: Scrape type for BW09320: 2
2026-03-28 05:43:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-28 05:43:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189bd547-49cd-561c-9b74-0283d2016b89 with scrape type 2
2026-03-28 05:43:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189bd547-49cd-561c-9b74-0283d2016b89 with scrape type 2
2026-03-28 05:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 189bd547-49cd-561c-9b74-0283d2016b89, identifier: BW09320
2026-03-28 05:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-28 05:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-28 05:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320 to the API
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:40:52Z',
 'fuel_type': 'diesel',
 'id': '189bd547-49cd-561c-9b74-0283d2016b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW09320',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 102077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2018}
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Saving data for BW09320: {'auction_closing_time': 1774716052.0, 'created_time': 1774552769.777307, 'last_price_update_time': 1774676625.355933}
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW09320') HTTP/1.1" 204 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN55210%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for DN55210: 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54467%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for WY54467: 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF17850%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for EF17850: 2
2026-03-28 05:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with identifier: EF17850
2026-03-28 05:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with scrape type 2
2026-03-28 05:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with scrape type 2
2026-03-28 05:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ff5eb50-6e15-5ade-890a-a32413c3bb83, identifier: EF17850
2026-03-28 05:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with identifier: EF17850
2026-03-28 05:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with identifier: EF17850
2026-03-28 05:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ff5eb50-6e15-5ade-890a-a32413c3bb83 with identifier: EF17850 to the API
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:36:24Z',
 'fuel_type': 'petrol',
 'id': '2ff5eb50-6e15-5ade-890a-a32413c3bb83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF17850',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 30245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-06',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Mild-Hybrid Comfort+',
 'transmission': 'manual',
 'trim': 'Comfort+',
 'year': 2023}
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF17850%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Saving data for EF17850: {'auction_closing_time': 1774715784.0, 'created_time': 1774466619.383502, 'last_price_update_time': 1774676625.909073}
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF17850') HTTP/1.1" 204 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for YK91002: 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for EG62319: 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU71497%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for UU71497: 0
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-28 05:43:45 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF03787%27 HTTP/1.1" 200 None
2026-03-28 05:43:45 [auto1.de] INFO: Scrape type for KF03787: 2
2026-03-28 05:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ede3a238-8d4e-5f83-961c-6a388534ade9 with identifier: KF03787
2026-03-28 05:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ede3a238-8d4e-5f83-961c-6a388534ade9 with scrape type 2
2026-03-28 05:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ede3a238-8d4e-5f83-961c-6a388534ade9 with scrape type 2
2026-03-28 05:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ede3a238-8d4e-5f83-961c-6a388534ade9, identifier: KF03787
2026-03-28 05:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ede3a238-8d4e-5f83-961c-6a388534ade9 with identifier: KF03787
2026-03-28 05:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ede3a238-8d4e-5f83-961c-6a388534ade9 with identifier: KF03787
2026-03-28 05:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ede3a238-8d4e-5f83-961c-6a388534ade9 with identifier: KF03787 to the API
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:37:31Z',
 'fuel_type': 'petrol',
 'id': 'ede3a238-8d4e-5f83-961c-6a388534ade9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF03787',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 56697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-13',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF03787%27 HTTP/1.1" 200 None
2026-03-28 05:43:46 [auto1.de] INFO: Saving data for KF03787: {'auction_closing_time': 1774715851.0, 'created_time': 1774466575.747469, 'last_price_update_time': 1774676626.430348}
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF03787') HTTP/1.1" 204 0
2026-03-28 05:43:46 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-28 05:43:46 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB59808%27 HTTP/1.1" 200 None
2026-03-28 05:43:46 [auto1.de] INFO: Scrape type for HB59808: 2
2026-03-28 05:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with identifier: HB59808
2026-03-28 05:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with scrape type 2
2026-03-28 05:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with scrape type 2
2026-03-28 05:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031, identifier: HB59808
2026-03-28 05:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with identifier: HB59808
2026-03-28 05:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with identifier: HB59808
2026-03-28 05:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031 with identifier: HB59808 to the API
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:22:11Z',
 'fuel_type': 'diesel',
 'id': '71d1b5d8-e137-5c1c-ab79-4ffd3f9e2031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB59808',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 143879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-23',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB59808%27 HTTP/1.1" 200 None
2026-03-28 05:43:46 [auto1.de] INFO: Saving data for HB59808: {'auction_closing_time': 1774714931.0, 'created_time': 1774467169.863302, 'last_price_update_time': 1774676626.956838}
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB59808') HTTP/1.1" 204 0
2026-03-28 05:43:46 [auto1.de] INFO: Found listing with ID: GP04602
2026-03-28 05:43:46 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-28 05:43:46 [auto1.de] INFO: Scrape type for AT78165: 2
2026-03-28 05:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-28 05:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aafff8dc-0862-5188-8d1d-eb334702cbf3 with scrape type 2
2026-03-28 05:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aafff8dc-0862-5188-8d1d-eb334702cbf3 with scrape type 2
2026-03-28 05:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aafff8dc-0862-5188-8d1d-eb334702cbf3, identifier: AT78165
2026-03-28 05:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-28 05:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-28 05:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165 to the API
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:57Z',
 'fuel_type': 'diesel',
 'id': 'aafff8dc-0862-5188-8d1d-eb334702cbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT78165',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 143123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2012}
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-28 05:43:47 [auto1.de] INFO: Saving data for AT78165: {'auction_closing_time': 1774715217.0, 'created_time': 1774552838.67817, 'last_price_update_time': 1774676627.395713}
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT78165') HTTP/1.1" 204 0
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: ML80867
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML80867%27 HTTP/1.1" 200 None
2026-03-28 05:43:47 [auto1.de] INFO: Scrape type for ML80867: 0
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: ZD20982
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD20982%27 HTTP/1.1" 200 None
2026-03-28 05:43:47 [auto1.de] INFO: Scrape type for ZD20982: 0
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP35635%27 HTTP/1.1" 200 None
2026-03-28 05:43:47 [auto1.de] INFO: Scrape type for GP35635: 0
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 05:43:47 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 05:43:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:48 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:48 [auto1.de] INFO: Found listing with ID: VE74198
2026-03-28 05:43:48 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-28 05:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-28 05:43:48 [auto1.de] INFO: Scrape type for VD76950: 2
2026-03-28 05:43:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-28 05:43:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ababa33a-fcbc-549f-abbe-7220dd0644fd with scrape type 2
2026-03-28 05:43:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ababa33a-fcbc-549f-abbe-7220dd0644fd with scrape type 2
2026-03-28 05:43:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ababa33a-fcbc-549f-abbe-7220dd0644fd, identifier: VD76950
2026-03-28 05:43:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-28 05:43:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950
2026-03-28 05:43:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ababa33a-fcbc-549f-abbe-7220dd0644fd with identifier: VD76950 to the API
2026-03-28 05:43:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:33:48Z',
 'fuel_type': 'petrol',
 'id': 'ababa33a-fcbc-549f-abbe-7220dd0644fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD76950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 117885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Saving data for VD76950: {'auction_closing_time': 1774715628.0, 'created_time': 1774467431.903285, 'last_price_update_time': 1774676629.077355}
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD76950') HTTP/1.1" 204 0
2026-03-28 05:43:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR60744%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for PR60744: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: CT34743
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT34743%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for CT34743: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for SL35659: 2
2026-03-28 05:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-28 05:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c327c553-d7cb-5a1a-954f-ae7c4c45a70d with scrape type 2
2026-03-28 05:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c327c553-d7cb-5a1a-954f-ae7c4c45a70d with scrape type 2
2026-03-28 05:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c327c553-d7cb-5a1a-954f-ae7c4c45a70d, identifier: SL35659
2026-03-28 05:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-28 05:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-28 05:43:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659 to the API
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-28T16:05:49Z',
 'fuel_type': 'diesel',
 'id': 'c327c553-d7cb-5a1a-954f-ae7c4c45a70d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL35659',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 171509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Saving data for SL35659: {'auction_closing_time': 1774713949.0, 'created_time': 1773342857.357318, 'last_price_update_time': 1774676629.726549}
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL35659') HTTP/1.1" 204 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for PU11267: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for UA25928: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU38218%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for GU38218: 0
2026-03-28 05:43:49 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX72487%27 HTTP/1.1" 200 None
2026-03-28 05:43:49 [auto1.de] INFO: Scrape type for KX72487: 2
2026-03-28 05:43:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a66aac5-251c-56e8-aa36-d388e58c2636 with identifier: KX72487
2026-03-28 05:43:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a66aac5-251c-56e8-aa36-d388e58c2636 with scrape type 2
2026-03-28 05:43:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a66aac5-251c-56e8-aa36-d388e58c2636 with scrape type 2
2026-03-28 05:43:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a66aac5-251c-56e8-aa36-d388e58c2636, identifier: KX72487
2026-03-28 05:43:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a66aac5-251c-56e8-aa36-d388e58c2636 with identifier: KX72487
2026-03-28 05:43:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a66aac5-251c-56e8-aa36-d388e58c2636 with identifier: KX72487
2026-03-28 05:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a66aac5-251c-56e8-aa36-d388e58c2636 with identifier: KX72487 to the API
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:42:16Z',
 'fuel_type': 'diesel',
 'id': '0a66aac5-251c-56e8-aa36-d388e58c2636',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX72487',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 195899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI PanAmericana 4Motion',
 'transmission': 'automatic',
 'trim': 'PanAmericana 4Motion',
 'year': 2019}
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX72487%27 HTTP/1.1" 200 None
2026-03-28 05:43:50 [auto1.de] INFO: Saving data for KX72487: {'auction_closing_time': 1774716136.0, 'created_time': 1773861405.538718, 'last_price_update_time': 1774676630.254917}
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX72487') HTTP/1.1" 204 0
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: XV84732
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV84732%27 HTTP/1.1" 200 None
2026-03-28 05:43:50 [auto1.de] INFO: Scrape type for XV84732: 0
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-28 05:43:50 [auto1.de] INFO: Scrape type for EP31898: 2
2026-03-28 05:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-28 05:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fed8f9-61f8-5511-a48d-1c960125504b with scrape type 2
2026-03-28 05:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fed8f9-61f8-5511-a48d-1c960125504b with scrape type 2
2026-03-28 05:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43fed8f9-61f8-5511-a48d-1c960125504b, identifier: EP31898
2026-03-28 05:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-28 05:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-28 05:43:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898 to the API
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:21:50Z',
 'fuel_type': 'diesel',
 'id': '43fed8f9-61f8-5511-a48d-1c960125504b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP31898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 175593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-28 05:43:50 [auto1.de] INFO: Saving data for EP31898: {'auction_closing_time': 1774714910.0, 'created_time': 1773946210.240584, 'last_price_update_time': 1774676630.813897}
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP31898') HTTP/1.1" 204 0
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: VR43125
2026-03-28 05:43:50 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-28 05:43:50 [auto1.de] INFO: Scrape type for BK73701: 2
2026-03-28 05:43:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-28 05:43:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with scrape type 2
2026-03-28 05:43:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with scrape type 2
2026-03-28 05:43:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c, identifier: BK73701
2026-03-28 05:43:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-28 05:43:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-28 05:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701 to the API
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:29:03Z',
 'fuel_type': 'petrol',
 'id': '62f4e23d-701a-580e-bd5d-3b5e990d0e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK73701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 138716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2014}
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Saving data for BK73701: {'auction_closing_time': 1774715343.0, 'created_time': 1774552889.652503, 'last_price_update_time': 1774676631.283533}
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK73701') HTTP/1.1" 204 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE94758%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for HE94758: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: HD83782
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83782%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for HD83782: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS15340%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for MS15340: 2
2026-03-28 05:43:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 487be89d-b487-5337-80ae-b20dcf13a1a4 with identifier: MS15340
2026-03-28 05:43:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 487be89d-b487-5337-80ae-b20dcf13a1a4 with scrape type 2
2026-03-28 05:43:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 487be89d-b487-5337-80ae-b20dcf13a1a4 with scrape type 2
2026-03-28 05:43:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 487be89d-b487-5337-80ae-b20dcf13a1a4, identifier: MS15340
2026-03-28 05:43:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 487be89d-b487-5337-80ae-b20dcf13a1a4 with identifier: MS15340
2026-03-28 05:43:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 487be89d-b487-5337-80ae-b20dcf13a1a4 with identifier: MS15340
2026-03-28 05:43:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 487be89d-b487-5337-80ae-b20dcf13a1a4 with identifier: MS15340 to the API
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:25:40Z',
 'fuel_type': 'petrol',
 'id': '487be89d-b487-5337-80ae-b20dcf13a1a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS15340',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 51237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS15340%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Saving data for MS15340: {'auction_closing_time': 1774715140.0, 'created_time': 1774468253.642079, 'last_price_update_time': 1774676631.78651}
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS15340') HTTP/1.1" 204 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ07380%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for SJ07380: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: NH90612
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH90612%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for NH90612: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-28 05:43:51 [auto1.de] INFO: Scrape type for LZ63004: 0
2026-03-28 05:43:51 [auto1.de] INFO: Found listing with ID: VN15291
2026-03-28 05:43:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN15291%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for VN15291: 0
2026-03-28 05:43:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:52 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for TA95211: 0
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: JH32543
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX11245%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for FX11245: 2
2026-03-28 05:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cf895f2-00e5-550e-a9dd-7ad008582214 with identifier: FX11245
2026-03-28 05:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cf895f2-00e5-550e-a9dd-7ad008582214 with scrape type 2
2026-03-28 05:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cf895f2-00e5-550e-a9dd-7ad008582214 with scrape type 2
2026-03-28 05:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cf895f2-00e5-550e-a9dd-7ad008582214, identifier: FX11245
2026-03-28 05:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cf895f2-00e5-550e-a9dd-7ad008582214 with identifier: FX11245
2026-03-28 05:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cf895f2-00e5-550e-a9dd-7ad008582214 with identifier: FX11245
2026-03-28 05:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cf895f2-00e5-550e-a9dd-7ad008582214 with identifier: FX11245 to the API
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:04:40Z',
 'fuel_type': 'petrol',
 'id': '0cf895f2-00e5-550e-a9dd-7ad008582214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX11245',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 44562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-28',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX11245%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Saving data for FX11245: {'auction_closing_time': 1774713880.0, 'created_time': 1774553214.540427, 'last_price_update_time': 1774676632.559468}
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX11245') HTTP/1.1" 204 0
2026-03-28 05:43:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for EK20296: 0
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for TN24608: 0
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ91223%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for VJ91223: 0
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP76557%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for NP76557: 0
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-28 05:43:52 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU33854%27 HTTP/1.1" 200 None
2026-03-28 05:43:52 [auto1.de] INFO: Scrape type for BU33854: 2
2026-03-28 05:43:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 705723cc-12c8-5718-87e5-b27474ccf272 with identifier: BU33854
2026-03-28 05:43:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 705723cc-12c8-5718-87e5-b27474ccf272 with scrape type 2
2026-03-28 05:43:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 705723cc-12c8-5718-87e5-b27474ccf272 with scrape type 2
2026-03-28 05:43:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 705723cc-12c8-5718-87e5-b27474ccf272, identifier: BU33854
2026-03-28 05:43:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 705723cc-12c8-5718-87e5-b27474ccf272 with identifier: BU33854
2026-03-28 05:43:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 705723cc-12c8-5718-87e5-b27474ccf272 with identifier: BU33854
2026-03-28 05:43:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 705723cc-12c8-5718-87e5-b27474ccf272 with identifier: BU33854 to the API
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': '705723cc-12c8-5718-87e5-b27474ccf272',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU33854',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 80373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seller_name': None,
 'title': 'Opel Astra 1.6 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'automatic',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU33854%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Saving data for BU33854: {'auction_closing_time': 1774714155.0, 'created_time': 1774467221.390488, 'last_price_update_time': 1774676633.106711}
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU33854') HTTP/1.1" 204 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for MG02873: 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR91951%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for JR91951: 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM83543%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for DM83543: 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: AL68838
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: AF55213
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: SL88176
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL88176%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for SL88176: 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for NX47984: 2
2026-03-28 05:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-28 05:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fb07cd-d00d-5b9e-a01c-d021131b3682 with scrape type 2
2026-03-28 05:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fb07cd-d00d-5b9e-a01c-d021131b3682 with scrape type 2
2026-03-28 05:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fb07cd-d00d-5b9e-a01c-d021131b3682, identifier: NX47984
2026-03-28 05:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-28 05:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-28 05:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984 to the API
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:39Z',
 'fuel_type': 'diesel',
 'id': '15fb07cd-d00d-5b9e-a01c-d021131b3682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX47984',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 226051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Saving data for NX47984: {'auction_closing_time': 1774715259.0, 'created_time': 1774553187.887162, 'last_price_update_time': 1774676633.720044}
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX47984') HTTP/1.1" 204 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: AM90654
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM90654%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for AM90654: 0
2026-03-28 05:43:53 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-28 05:43:53 [auto1.de] INFO: Scrape type for AE81199: 2
2026-03-28 05:43:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-28 05:43:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with scrape type 2
2026-03-28 05:43:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with scrape type 2
2026-03-28 05:43:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62, identifier: AE81199
2026-03-28 05:43:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-28 05:43:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-28 05:43:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199 to the API
2026-03-28 05:43:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:42Z',
 'fuel_type': 'petrol',
 'id': 'cdbe779b-65b8-5b9e-bbf1-8323dd4abe62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE81199',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 121294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Saving data for AE81199: {'auction_closing_time': 1774714902.0, 'created_time': 1774552999.217942, 'last_price_update_time': 1774676634.16039}
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE81199') HTTP/1.1" 204 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for NS17757: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for RU51432: 2
2026-03-28 05:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-28 05:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643faf7f-1931-537f-b434-8e347cc4400e with scrape type 2
2026-03-28 05:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643faf7f-1931-537f-b434-8e347cc4400e with scrape type 2
2026-03-28 05:43:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643faf7f-1931-537f-b434-8e347cc4400e, identifier: RU51432
2026-03-28 05:43:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-28 05:43:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-28 05:43:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432 to the API
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:20:14Z',
 'fuel_type': 'diesel',
 'id': '643faf7f-1931-537f-b434-8e347cc4400e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU51432',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 88666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XLT',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 XLT',
 'year': 2018}
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Saving data for RU51432: {'auction_closing_time': 1774714814.0, 'created_time': 1774552854.958715, 'last_price_update_time': 1774676634.768851}
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU51432') HTTP/1.1" 204 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for NX61710: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: LL60236
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW00084%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for CW00084: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for NW88180: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD86732%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for TD86732: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY30248%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for CY30248: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-28 05:43:54 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18198%27 HTTP/1.1" 200 None
2026-03-28 05:43:54 [auto1.de] INFO: Scrape type for BW18198: 2
2026-03-28 05:43:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38e6490-8a19-516d-b890-45ad83e1e09a with identifier: BW18198
2026-03-28 05:43:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38e6490-8a19-516d-b890-45ad83e1e09a with scrape type 2
2026-03-28 05:43:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38e6490-8a19-516d-b890-45ad83e1e09a with scrape type 2
2026-03-28 05:43:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38e6490-8a19-516d-b890-45ad83e1e09a, identifier: BW18198
2026-03-28 05:43:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38e6490-8a19-516d-b890-45ad83e1e09a with identifier: BW18198
2026-03-28 05:43:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38e6490-8a19-516d-b890-45ad83e1e09a with identifier: BW18198
2026-03-28 05:43:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38e6490-8a19-516d-b890-45ad83e1e09a with identifier: BW18198 to the API
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:07:13Z',
 'fuel_type': 'petrol',
 'id': 'f38e6490-8a19-516d-b890-45ad83e1e09a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW18198',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 55870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2016}
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18198%27 HTTP/1.1" 200 None
2026-03-28 05:43:55 [auto1.de] INFO: Saving data for BW18198: {'auction_closing_time': 1774714033.0, 'created_time': 1774466608.500506, 'last_price_update_time': 1774676635.378346}
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW18198') HTTP/1.1" 204 0
2026-03-28 05:43:55 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 05:43:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:56 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TZ47982
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ82466%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for RZ82466: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ24740%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for SJ24740: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: UZ74355
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: NS26780
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS26780%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for NS26780: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for PS90319: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB67403%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for LB67403: 2
2026-03-28 05:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with identifier: LB67403
2026-03-28 05:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with scrape type 2
2026-03-28 05:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with scrape type 2
2026-03-28 05:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ebaa834-bfb4-5d9f-8324-a2d7161f949f, identifier: LB67403
2026-03-28 05:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with identifier: LB67403
2026-03-28 05:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with identifier: LB67403
2026-03-28 05:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ebaa834-bfb4-5d9f-8324-a2d7161f949f with identifier: LB67403 to the API
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:23Z',
 'fuel_type': 'diesel',
 'id': '3ebaa834-bfb4-5d9f-8324-a2d7161f949f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB67403',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 151481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion',
 'transmission': 'manual',
 'trim': 'Life 4Motion',
 'year': 2013}
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB67403%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Saving data for LB67403: {'auction_closing_time': 1774715903.0, 'created_time': 1774468286.795993, 'last_price_update_time': 1774676636.555338}
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB67403') HTTP/1.1" 204 0
2026-03-28 05:43:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05808%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for JF05808: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TK16226
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: DJ51254
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ51254%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for DJ51254: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: MC69974
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69974%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for MC69974: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for SW40365: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for AH38821: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for JS58048: 0
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 05:43:56 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-28 05:43:56 [auto1.de] INFO: Scrape type for TH98147: 2
2026-03-28 05:43:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-28 05:43:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2a4398-f37a-5d49-846b-f8e030c3614a with scrape type 2
2026-03-28 05:43:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d2a4398-f37a-5d49-846b-f8e030c3614a with scrape type 2
2026-03-28 05:43:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d2a4398-f37a-5d49-846b-f8e030c3614a, identifier: TH98147
2026-03-28 05:43:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-28 05:43:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-28 05:43:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147 to the API
2026-03-28 05:43:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:31Z',
 'fuel_type': 'diesel',
 'id': '1d2a4398-f37a-5d49-846b-f8e030c3614a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH98147',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 133310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2021}
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-28 05:43:57 [auto1.de] INFO: Saving data for TH98147: {'auction_closing_time': 1774716091.0, 'created_time': 1772727321.442733, 'last_price_update_time': 1774676637.147775}
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH98147') HTTP/1.1" 204 0
2026-03-28 05:43:57 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-28 05:43:57 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN71189%27 HTTP/1.1" 200 None
2026-03-28 05:43:57 [auto1.de] INFO: Scrape type for SN71189: 2
2026-03-28 05:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with identifier: SN71189
2026-03-28 05:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with scrape type 2
2026-03-28 05:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with scrape type 2
2026-03-28 05:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18ac208f-d0aa-51e8-927c-e07dd1d95b97, identifier: SN71189
2026-03-28 05:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with identifier: SN71189
2026-03-28 05:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with identifier: SN71189
2026-03-28 05:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18ac208f-d0aa-51e8-927c-e07dd1d95b97 with identifier: SN71189 to the API
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:37:02Z',
 'fuel_type': 'diesel',
 'id': '18ac208f-d0aa-51e8-927c-e07dd1d95b97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN71189',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 291058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2016}
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN71189%27 HTTP/1.1" 200 None
2026-03-28 05:43:57 [auto1.de] INFO: Saving data for SN71189: {'auction_closing_time': 1774715822.0, 'created_time': 1774468270.858464, 'last_price_update_time': 1774676637.705979}
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN71189') HTTP/1.1" 204 0
2026-03-28 05:43:57 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-28 05:43:57 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-28 05:43:57 [auto1.de] INFO: Scrape type for HB57575: 2
2026-03-28 05:43:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-28 05:43:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db95980-fbde-50c9-8789-e7cdebd4bec7 with scrape type 2
2026-03-28 05:43:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db95980-fbde-50c9-8789-e7cdebd4bec7 with scrape type 2
2026-03-28 05:43:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6db95980-fbde-50c9-8789-e7cdebd4bec7, identifier: HB57575
2026-03-28 05:43:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-28 05:43:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-28 05:43:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575 to the API
2026-03-28 05:43:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:30:43Z',
 'fuel_type': 'petrol',
 'id': '6db95980-fbde-50c9-8789-e7cdebd4bec7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB57575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 163885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Saving data for HB57575: {'auction_closing_time': 1774715443.0, 'created_time': 1774552751.292162, 'last_price_update_time': 1774676638.15379}
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB57575') HTTP/1.1" 204 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: UC97220
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC97220%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for UC97220: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for RG09784: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR87119%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for HR87119: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH73530%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for XH73530: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53525%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for SS53525: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for SM57605: 0
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 05:43:58 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD37503%27 HTTP/1.1" 200 None
2026-03-28 05:43:58 [auto1.de] INFO: Scrape type for TD37503: 0
2026-03-28 05:43:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:43:59 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9199 | hits on page: 40
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for WJ79239: 0
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: MU84465
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF58362%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for PF58362: 0
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP76124%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for FP76124: 2
2026-03-28 05:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eddb848-d6bf-5938-892b-244f2c53ff85 with identifier: FP76124
2026-03-28 05:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eddb848-d6bf-5938-892b-244f2c53ff85 with scrape type 2
2026-03-28 05:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eddb848-d6bf-5938-892b-244f2c53ff85 with scrape type 2
2026-03-28 05:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eddb848-d6bf-5938-892b-244f2c53ff85, identifier: FP76124
2026-03-28 05:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eddb848-d6bf-5938-892b-244f2c53ff85 with identifier: FP76124
2026-03-28 05:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eddb848-d6bf-5938-892b-244f2c53ff85 with identifier: FP76124
2026-03-28 05:43:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eddb848-d6bf-5938-892b-244f2c53ff85 with identifier: FP76124 to the API
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:05Z',
 'fuel_type': 'petrol',
 'id': '2eddb848-d6bf-5938-892b-244f2c53ff85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP76124',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 213287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP76124%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Saving data for FP76124: {'auction_closing_time': 1774714925.0, 'created_time': 1774466841.041175, 'last_price_update_time': 1774676639.752736}
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP76124') HTTP/1.1" 204 0
2026-03-28 05:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-28 05:43:59 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-28 05:43:59 [auto1.de] INFO: Scrape type for EN92666: 2
2026-03-28 05:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-28 05:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e527c72-ec18-53d3-85bc-41b6ecabf712 with scrape type 2
2026-03-28 05:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e527c72-ec18-53d3-85bc-41b6ecabf712 with scrape type 2
2026-03-28 05:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e527c72-ec18-53d3-85bc-41b6ecabf712, identifier: EN92666
2026-03-28 05:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-28 05:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-28 05:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666 to the API
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:08:27Z',
 'fuel_type': 'diesel',
 'id': '6e527c72-ec18-53d3-85bc-41b6ecabf712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN92666',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 355454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Saving data for EN92666: {'auction_closing_time': 1774714107.0, 'created_time': 1773916592.110068, 'last_price_update_time': 1774676640.343543}
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN92666') HTTP/1.1" 204 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: MD04990
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD04990%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Scrape type for MD04990: 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Scrape type for NH29659: 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK05183%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Scrape type for CK05183: 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Scrape type for HN30434: 2
2026-03-28 05:44:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-28 05:44:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with scrape type 2
2026-03-28 05:44:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with scrape type 2
2026-03-28 05:44:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9, identifier: HN30434
2026-03-28 05:44:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-28 05:44:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434
2026-03-28 05:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9 with identifier: HN30434 to the API
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:53Z',
 'fuel_type': 'diesel',
 'id': '288a95f0-a5ac-5e62-9a4a-ba7e7a538ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN30434',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 193430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-23',
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-28 05:44:00 [auto1.de] INFO: Saving data for HN30434: {'auction_closing_time': 1774715153.0, 'created_time': 1774468025.602828, 'last_price_update_time': 1774676640.883825}
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN30434') HTTP/1.1" 204 0
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: ZJ77076
2026-03-28 05:44:00 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for CL67465: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: SL22871
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL22871%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for SL22871: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for NR35132: 2
2026-03-28 05:44:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-28 05:44:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0515e77-5901-5bf6-9e8e-2b86437bea98 with scrape type 2
2026-03-28 05:44:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0515e77-5901-5bf6-9e8e-2b86437bea98 with scrape type 2
2026-03-28 05:44:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0515e77-5901-5bf6-9e8e-2b86437bea98, identifier: NR35132
2026-03-28 05:44:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-28 05:44:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-28 05:44:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132 to the API
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:44:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:32:33Z',
 'fuel_type': 'petrol',
 'id': 'd0515e77-5901-5bf6-9e8e-2b86437bea98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR35132',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 323476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-08',
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Saving data for NR35132: {'auction_closing_time': 1774715553.0, 'created_time': 1774553249.413059, 'last_price_update_time': 1774676641.466163}
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35132') HTTP/1.1" 204 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: LE21028
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21028%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for LE21028: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN28184%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for EN28184: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: MN16875
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN16875%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for MN16875: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: FJ59551
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59551%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for FJ59551: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: AV05824
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: JS88024
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS88024%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for JS88024: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for WM05984: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-28 05:44:01 [auto1.de] INFO: Found listing with ID: EM02762
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM02762%27 HTTP/1.1" 200 None
2026-03-28 05:44:01 [auto1.de] INFO: Scrape type for EM02762: 0
2026-03-28 05:44:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:02 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: DW83875
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW83875%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for DW83875: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for NK75444: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: AW09082
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for AS89586: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: DR39868
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR39868%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for DR39868: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: XE25364
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE25364%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for XE25364: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for BV75755: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: BZ38132
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: MS67851
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: JY42391
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: RB92475
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB92475%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for RB92475: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: FZ45085
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: YE52514
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: AK40510
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for CJ04557: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: KM46516
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for NL19683: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for WC37981: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: PM59484
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM59484%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for PM59484: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for RK76188: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for VN12200: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: AC23396
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC23396%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for AC23396: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for UD27058: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: BV95074
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV95074%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for BV95074: 0
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: DY63135
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: TH48846
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-28 05:44:02 [auto1.de] INFO: Found listing with ID: NE41084
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE41084%27 HTTP/1.1" 200 None
2026-03-28 05:44:02 [auto1.de] INFO: Scrape type for NE41084: 0
2026-03-28 05:44:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:03 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for MR97164: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for LF08399: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for PM35820: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU55030%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for RU55030: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: WW62013
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW62013%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for WW62013: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: WR30100
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR30100%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for WR30100: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: XV83680
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: YH32821
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32821%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for YH32821: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-28 05:44:03 [auto1.de] INFO: Scrape type for EE66446: 0
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: AG95763
2026-03-28 05:44:03 [auto1.de] INFO: Found listing with ID: HB95845
2026-03-28 05:44:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95845%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for HB95845: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for DC02620: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: WT35488
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: DV40651
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40651%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for DV40651: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: RT81872
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: VF65957
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF65957%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for VF65957: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH24337%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for NH24337: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP35212%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for AP35212: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: FS21817
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS21817%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for FS21817: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: NV29548
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV29548%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for NV29548: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: YC36661
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: FB28212
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: XV50730
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50730%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for XV50730: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: AB51918
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: WB14215
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB14215%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for WB14215: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: WX47681
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX47681%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for WX47681: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: FN84254
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: VL22817
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL22817%27 HTTP/1.1" 200 None
2026-03-28 05:44:04 [auto1.de] INFO: Scrape type for VL22817: 0
2026-03-28 05:44:04 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-28 05:44:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:05 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: VV56581
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: PH05678
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH05678%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for PH05678: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: ZR87762
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: CG13021
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG13021%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for CG13021: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: SW73326
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: FH57861
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH57861%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for FH57861: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: NR21385
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21385%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for NR21385: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for MB34428: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: UE28545
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28545%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for UE28545: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: DP38441
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: EZ75910
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ75910%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for EZ75910: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT92868%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for CT92868: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: WF64949
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: LX19893
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19893%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for LX19893: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: ED90776
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: XB12574
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB12574%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for XB12574: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: GS10742
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for ZF51547: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for FY44506: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for NV36056: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: SB19152
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: VU26933
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26933%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for VU26933: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: PV39631
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV39631%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for PV39631: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: BE79693
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE79693%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for BE79693: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: EL88156
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: UV51707
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for NR97756: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: WJ30276
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: HS07572
2026-03-28 05:44:05 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-28 05:44:05 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-28 05:44:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:06 [scrapy.extensions.logstats] INFO: Crawled 168 pages (at 18 pages/min), scraped 669 items (at 78 items/min)
2026-03-28 05:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 177MiB
2026-03-28 05:44:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:06 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: FG49990
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG49990%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for FG49990: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: EW66655
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: PG72252
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: MA26612
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA26612%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for MA26612: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: ST40572
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for BB55573: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: JU35192
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU35192%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for JU35192: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for BB56040: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: EL52738
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL52738%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for EL52738: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-28 05:44:06 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-28 05:44:06 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 05:44:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: UC42485
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: ZH33487
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-28 05:44:07 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-28 05:44:07 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 05:44:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:08 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: NZ73974
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ73974%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for NZ73974: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: CG19122
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: TU49372
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: US66505
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66505%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for US66505: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: TZ79275
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: LW88840
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: TL33635
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL33635%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for TL33635: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: SX18617
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18617%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for SX18617: 0
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: ZS32516
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 05:44:08 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-28 05:44:08 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-28 05:44:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:09 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: FP85945
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP85945%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for FP85945: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: KZ93271
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ93271%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for KZ93271: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: EL64593
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL64593%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for EL64593: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: MJ27519
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ27519%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for MJ27519: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: FV38538
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV38538%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for FV38538: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: FJ25741
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ25741%27 HTTP/1.1" 200 None
2026-03-28 05:44:09 [auto1.de] INFO: Scrape type for FJ25741: 1
2026-03-28 05:44:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:09 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: AX65936
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX65936%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for AX65936: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: GZ32415
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: JW43504
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW43504%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for JW43504: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: KX05072
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: ST70161
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST70161%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for ST70161: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: NG47626
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: RU88109
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: ES58004
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES58004%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for ES58004: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-28 05:44:10 [auto1.de] INFO: Found listing with ID: JA32150
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA32150%27 HTTP/1.1" 200 None
2026-03-28 05:44:10 [auto1.de] INFO: Scrape type for JA32150: 0
2026-03-28 05:44:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:11 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP11362%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for FP11362: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: XF72259
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF72259%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for XF72259: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: TE65215
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE65215%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for TE65215: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN61962%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for EN61962: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB27715%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for YB27715: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: JB48041
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: VK55236
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK55236%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for VK55236: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: YP75946
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP75946%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for YP75946: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: BE74196
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: MA19340
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for DN59974: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: LA55679
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA55679%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for LA55679: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: PW59842
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: TE19568
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE19568%27 HTTP/1.1" 200 None
2026-03-28 05:44:11 [auto1.de] INFO: Scrape type for TE19568: 0
2026-03-28 05:44:11 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 05:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ25741/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:12 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: WZ27773
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: CG60505
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for UZ05424: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: JH49592
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH49592%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for JH49592: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-28 05:44:12 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 05:44:12 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: HJ47898
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: JM37060
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM37060%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for JM37060: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: KB63529
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB63529%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for KB63529: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: KC83208
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC83208%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for KC83208: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: DF80401
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: AK10230
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10230%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for AK10230: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: XF71877
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: GE38296
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: TC10400
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: LW37841
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: UZ23032
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ23032%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for UZ23032: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: MU37788
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: ST46361
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: CV46070
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-28 05:44:13 [auto1.de] INFO: Found listing with ID: GE13857
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE13857%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [auto1.de] INFO: Scrape type for GE13857: 0
2026-03-28 05:44:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ25741> (referer: https://www.auto1.com/v1/car-details-view/FJ25741/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with identifier: FJ25741
2026-03-28 05:44:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with scrape type 1
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_f88bd8388759797e0bcb29733485ef93.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_f88bd8388759797e0bcb29733485ef93.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_de67ac90ea435403cc9d3411b0424a66.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_de67ac90ea435403cc9d3411b0424a66.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_126feb827b5eb38a507968363b750bde.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_126feb827b5eb38a507968363b750bde.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_8059f987f7cfdcbdd2be594619235776.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_8059f987f7cfdcbdd2be594619235776.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg not downloaded yet
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg not downloaded yet
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg not downloaded yet
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg not downloaded yet
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_f88bd8388759797e0bcb29733485ef93.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_de67ac90ea435403cc9d3411b0424a66.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf79a10>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_0.jpg HTTP/1.1" 201 0
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_f88bd8388759797e0bcb29733485ef93.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_f88bd8388759797e0bcb29733485ef93.jpg saved to cache
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22da51e090>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_1.jpg HTTP/1.1" 201 0
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_de67ac90ea435403cc9d3411b0424a66.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_de67ac90ea435403cc9d3411b0424a66.jpg saved to cache
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafc96d0>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_2.jpg HTTP/1.1" 201 0
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg saved to cache
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22daf62810>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_8.jpg HTTP/1.1" 201 0
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg saved to cache
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafe8e10>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_6.jpg HTTP/1.1" 201 0
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg saved to cache
2026-03-28 05:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22dafea690>
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_7.jpg HTTP/1.1" 201 0
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg saved to cache
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_8059f987f7cfdcbdd2be594619235776.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_126feb827b5eb38a507968363b750bde.jpg> (referer: https://www.auto1.com/)
2026-03-28 05:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e0066b10>
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_4.jpg HTTP/1.1" 201 0
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_8059f987f7cfdcbdd2be594619235776.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_8059f987f7cfdcbdd2be594619235776.jpg saved to cache
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e01d14d0>
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_5.jpg HTTP/1.1" 201 0
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg saved to cache
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22da51d4d0>
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_9.jpg HTTP/1.1" 201 0
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg saved to cache
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f22e020bfd0>
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 05:44:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_3.jpg HTTP/1.1" 201 0
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252Ffe%252Fa9fedfb5a2a3d64e06d7ab1ae993e8a9%252Fpa%252FFJ25741_126feb827b5eb38a507968363b750bde.jpg') HTTP/1.1" 204 0
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_126feb827b5eb38a507968363b750bde.jpg saved to cache
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19
2026-03-28 05:44:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8dc0f7f-68ca-56c8-b525-ba39ff919d19, skipping ID generation
2026-03-28 05:44:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with scrape type 1
2026-03-28 05:44:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8dc0f7f-68ca-56c8-b525-ba39ff919d19 sending to next pipeline
2026-03-28 05:44:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8dc0f7f-68ca-56c8-b525-ba39ff919d19, identifier: FJ25741
2026-03-28 05:44:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with identifier: FJ25741
2026-03-28 05:44:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with identifier: FJ25741
2026-03-28 05:44:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8dc0f7f-68ca-56c8-b525-ba39ff919d19 with identifier: FJ25741 to the API
2026-03-28 05:44:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:44:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:44:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_126feb827b5eb38a507968363b750bde.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:30:59Z',
 'fuel_type': 'petrol',
 'id': 'c8dc0f7f-68ca-56c8-b525-ba39ff919d19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ25741',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 64240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_f88bd8388759797e0bcb29733485ef93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2763955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_de67ac90ea435403cc9d3411b0424a66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_5be8fa807d49c8fb59d412cf97ed366e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_126feb827b5eb38a507968363b750bde.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703412,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_8059f987f7cfdcbdd2be594619235776.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790617,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0ed1d8561e51590d9fc0bc5652d584cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2827451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_aa3902a284ef1d19cb8af360dd12d915.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_0e9679f05bd22883b81f3cf14087bf92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_d9f9dc61af9562d3819485d38bfcd0e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8dc0f7f-68ca-56c8-b525-ba39ff919d19/c8dc0f7f-68ca-56c8-b525-ba39ff919d19_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2686881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/fe/a9fedfb5a2a3d64e06d7ab1ae993e8a9/pa/FJ25741_4c5637540d1b344c874ac9c9c19854f9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Essential',
 'transmission': 'manual',
 'trim': 'Stepway Essential',
 'year': 2019}
2026-03-28 05:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ25741%27 HTTP/1.1" 200 None
2026-03-28 05:44:16 [auto1.de] INFO: Saving data for FJ25741: {'created_time': 1774676656.212478, 'last_price_update_time': 1774676656.212489, 'auction_closing_time': 1774715459.0}
2026-03-28 05:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ25741') HTTP/1.1" 204 0
2026-03-28 05:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:17 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:17 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-28 05:44:17 [auto1.de] INFO: Found listing with ID: UC90003
2026-03-28 05:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC90003%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for UC90003: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: PM00839
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM00839%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for PM00839: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: RA09675
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA09675%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for RA09675: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YN58840
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN58840%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for YN58840: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: SR24590
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR24590%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for SR24590: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: WP38302
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: LL32931
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL32931%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for LL32931: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: JR72370
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR72370%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for JR72370: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: LH42937
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: RK58200
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: NW48932
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW48932%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for NW48932: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: CU25460
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: LB53588
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB53588%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for LB53588: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: VU78681
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78681%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for VU78681: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: NH66638
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YB76933
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: KB30822
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: UW51602
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW51602%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for UW51602: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: WB23557
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB23557%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for WB23557: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: PV88036
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: PT29728
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29728%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for PT29728: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: GR22729
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93356%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for CH93356: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: FV31347
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV31347%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for FV31347: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: RL64280
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL64280%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for RL64280: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for AP67523: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: WJ27645
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: YU45811
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU45811%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for YU45811: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: HJ23200
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ23200%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for HJ23200: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: LM35319
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM35319%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for LM35319: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-28 05:44:18 [auto1.de] INFO: Found listing with ID: ND92917
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND92917%27 HTTP/1.1" 200 None
2026-03-28 05:44:18 [auto1.de] INFO: Scrape type for ND92917: 0
2026-03-28 05:44:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:19 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: GC41711
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC41711%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for GC41711: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: RT85975
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT85975%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for RT85975: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: CZ37102
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: UN55665
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN55665%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for UN55665: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: SX94415
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: ZH78553
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: GZ12434
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ12434%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for GZ12434: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: EF19771
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: NJ07405
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: TM10455
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: DM85685
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: EU26166
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: GS88086
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: UH92417
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for XV57552: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: ZF36287
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: UY49029
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY49029%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for UY49029: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: PB03709
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB03709%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for PB03709: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: MT89119
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: LB55068
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: EV33886
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV33886%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for EV33886: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: DH53095
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH53095%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for DH53095: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for TM91896: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: ES20702
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20702%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for ES20702: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: BR66744
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: SY93073
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY93073%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for SY93073: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: XE28025
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE28025%27 HTTP/1.1" 200 None
2026-03-28 05:44:19 [auto1.de] INFO: Scrape type for XE28025: 0
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: LB14503
2026-03-28 05:44:19 [auto1.de] INFO: Found listing with ID: DF28999
2026-03-28 05:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:20 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-28 05:44:20 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: PT66739
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: MK93250
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: SM85227
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM85227%27 HTTP/1.1" 200 None
2026-03-28 05:44:20 [auto1.de] INFO: Scrape type for SM85227: 0
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: CG03839
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: YJ11714
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ11714%27 HTTP/1.1" 200 None
2026-03-28 05:44:20 [auto1.de] INFO: Scrape type for YJ11714: 0
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: NV96108
2026-03-28 05:44:20 [auto1.de] INFO: Found listing with ID: VY22890
2026-03-28 05:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22890%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for VY22890: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: DS58679
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS58679%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for DS58679: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for PL85371: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: VL80954
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: ZE45705
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: DE08744
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: EN22144
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: LA72906
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: MF16009
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF16009%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for MF16009: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: WK49027
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: KG21612
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG21612%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for KG21612: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: YV29892
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV29892%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for YV29892: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: WZ80010
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: CC70262
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: DV15520
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: CT94694
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: VV43208
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: KL57981
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL57981%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for KL57981: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: CU33421
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: PF93593
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: KS12992
2026-03-28 05:44:21 [auto1.de] INFO: Found listing with ID: FH56262
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56262%27 HTTP/1.1" 200 None
2026-03-28 05:44:21 [auto1.de] INFO: Scrape type for FH56262: 0
2026-03-28 05:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:22 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: MG09905
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: MT78692
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT78692%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for MT78692: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: LS44265
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS44265%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for LS44265: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: TC94851
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: TM61103
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: KT77585
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT77585%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for KT77585: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: XB19891
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: TJ66673
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: DH53166
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: ZE31778
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE31778%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for ZE31778: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: RD12421
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD12421%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for RD12421: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: RJ07463
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: GE45533
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE45533%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for GE45533: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: GU99476
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU99476%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for GU99476: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: HF74785
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for CZ70893: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: EZ84115
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ84115%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for EZ84115: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: CF13145
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: EG69699
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: LZ69181
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: RL63795
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL63795%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for RL63795: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: WG13195
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: NT25501
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT25501%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for NT25501: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for CM64848: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: US44062
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: PA16133
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA16133%27 HTTP/1.1" 200 None
2026-03-28 05:44:22 [auto1.de] INFO: Scrape type for PA16133: 0
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: TD01616
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: YV04916
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: ES00815
2026-03-28 05:44:22 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-28 05:44:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:23 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: EZ87167
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: AB91886
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91886%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for AB91886: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: FZ73081
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ73081%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for FZ73081: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for NG98905: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: ZZ70477
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: FG85844
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: FX17983
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17983%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for FX17983: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: LE68165
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE68165%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for LE68165: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: XV51445
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV51445%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for XV51445: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: NJ50287
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: NN96342
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN96342%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for NN96342: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: GX56948
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: MC19465
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: BK94626
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: ND36450
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND36450%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for ND36450: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: VB51991
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: NB13742
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB13742%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for NB13742: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: TH46997
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH46997%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for TH46997: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: EW90730
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: VN33107
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN33107%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for VN33107: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: EE21023
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: CX63821
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: JL38639
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL38639%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for JL38639: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: GR03981
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: GD37496
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: AM26890
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: PU65266
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: PW54296
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: HU83271
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU83271%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for HU83271: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-28 05:44:23 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-28 05:44:23 [auto1.de] INFO: Found listing with ID: FR08984
2026-03-28 05:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:24 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:24 [auto1.de] INFO: Found listing with ID: ZA36261
2026-03-28 05:44:24 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: WC48972
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: VL97959
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: XP39668
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: TE02637
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE02637%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for TE02637: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: AJ02147
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ02147%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for AJ02147: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: JW75364
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: BY93360
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: LZ33123
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ33123%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for LZ33123: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: DW18994
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: TX71823
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: SH29410
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: FP38925
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: PS70153
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: ZT34226
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT34226%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for ZT34226: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: TJ69662
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for EH70293: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: GR93204
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR93204%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for GR93204: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: ME49426
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: VH05156
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH05156%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for VH05156: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: AJ94093
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ94093%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for AJ94093: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: KN83228
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: SX49755
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX49755%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for SX49755: 0
2026-03-28 05:44:25 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-28 05:44:25 [auto1.de] INFO: Scrape type for JW05859: 0
2026-03-28 05:44:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:26 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for ST09245: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: TE58325
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: PB84737
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: FX80004
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: CK93419
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for EH26353: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: TT01449
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT01449%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for TT01449: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: RX36269
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX36269%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for RX36269: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: MS42398
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42398%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for MS42398: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: NX20586
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX20586%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for NX20586: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: TY55277
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: XA91710
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA91710%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for XA91710: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: KD57513
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: PD68131
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD68131%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for PD68131: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: LZ01049
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ01049%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for LZ01049: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: VY10328
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10328%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for VY10328: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: RC78324
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78324%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for RC78324: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: BK70800
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: EN44355
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN44355%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for EN44355: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: SX37933
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX37933%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for SX37933: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: ZE74585
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: PA55939
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: BH36406
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH36406%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for BH36406: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-28 05:44:26 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-28 05:44:26 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-28 05:44:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:27 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: GA16313
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA16313%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for GA16313: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: RC54937
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC54937%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for RC54937: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: CN28958
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN28958%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for CN28958: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: KY35163
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY35163%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for KY35163: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-28 05:44:27 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-28 05:44:27 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: AA47357
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA47357%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for AA47357: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: XU32794
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU32794%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for XU32794: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: TL68134
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-28 05:44:28 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-28 05:44:28 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-28 05:44:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:29 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: ST20646
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: UF64612
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF64612%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for UF64612: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: LF59427
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-28 05:44:29 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-28 05:44:29 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: AD82327
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD82327%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for AD82327: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: KE33032
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE33032%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for KE33032: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: EP50641
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP50641%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for EP50641: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: LX99570
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: LA20568
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA20568%27 HTTP/1.1" 200 None
2026-03-28 05:44:30 [auto1.de] INFO: Scrape type for LA20568: 0
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 05:44:30 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 05:44:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:31 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CR14297
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: EY40312
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY40312%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for EY40312: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: DT18968
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT18968%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for DT18968: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: KD59460
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD59460%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for KD59460: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: AN41725
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NN27576
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-28 05:44:31 [auto1.de] INFO: Found listing with ID: NX98593
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98593%27 HTTP/1.1" 200 None
2026-03-28 05:44:31 [auto1.de] INFO: Scrape type for NX98593: 0
2026-03-28 05:44:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:32 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: UK22144
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: HF90366
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: LK57137
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: NA93795
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA93795%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for NA93795: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-28 05:44:32 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: DZ81579
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 05:44:32 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: ML18265
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML18265%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for ML18265: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: RT17429
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: CN48396
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN48396%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for CN48396: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-28 05:44:33 [auto1.de] INFO: Found listing with ID: FF27762
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF27762%27 HTTP/1.1" 200 None
2026-03-28 05:44:33 [auto1.de] INFO: Scrape type for FF27762: 0
2026-03-28 05:44:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:37 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: YY58464
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY58464%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for YY58464: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: AM53740
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: EM43051
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM43051%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for EM43051: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: FF42926
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: TR57045
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: WM35972
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM35972%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for WM35972: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP84561%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for LP84561: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: DK79319
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK79319%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for DK79319: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: PK53003
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK53003%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for PK53003: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: VR97101
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97101%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for VR97101: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for BM26089: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: XH45962
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: ME71615
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: TT01725
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU24263%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for JU24263: 0
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 05:44:37 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-28 05:44:37 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-28 05:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:38 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: YE44037
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: PH72669
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: RX15047
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: SY58085
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: SR36375
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: YM65091
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM65091%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for YM65091: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-28 05:44:38 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-28 05:44:38 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 05:44:39 [auto1.de] INFO: Found listing with ID: DX69622
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX69622%27 HTTP/1.1" 200 None
2026-03-28 05:44:39 [auto1.de] INFO: Scrape type for DX69622: 0
2026-03-28 05:44:39 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 05:44:39 [auto1.de] INFO: Found listing with ID: ZL39165
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL39165%27 HTTP/1.1" 200 None
2026-03-28 05:44:39 [auto1.de] INFO: Scrape type for ZL39165: 0
2026-03-28 05:44:39 [auto1.de] INFO: Found listing with ID: LX80768
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX80768%27 HTTP/1.1" 200 None
2026-03-28 05:44:39 [auto1.de] INFO: Scrape type for LX80768: 0
2026-03-28 05:44:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:40 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: JX03592
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: AM12190
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: RJ67815
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ67815%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for RJ67815: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: ZY51606
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY51606%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for ZY51606: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: RL99236
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL99236%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for RL99236: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: SR10542
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10542%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for SR10542: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: KJ72573
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: JG05380
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-28 05:44:40 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-28 05:44:40 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 05:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:41 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: NP38313
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP38313%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for NP38313: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: UR28246
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR28246%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for UR28246: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: WE47362
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: BP64224
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-28 05:44:41 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 05:44:41 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: SZ20099
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20099%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for SZ20099: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: LM23277
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM23277%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for LM23277: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: VM20095
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM20095%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for VM20095: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: WA68038
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: TC39973
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-28 05:44:42 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-28 05:44:42 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 05:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:43 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: YX67220
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: CC63606
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC63606%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for CC63606: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: SY49649
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY49649%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for SY49649: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: EA35621
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA35621%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for EA35621: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: DB64209
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64209%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for DB64209: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: XG90247
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: KN40291
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: EP13780
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: FK17094
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17094%27 HTTP/1.1" 200 None
2026-03-28 05:44:43 [auto1.de] INFO: Scrape type for FK17094: 0
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 05:44:43 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 05:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:44 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: GY29041
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: NB41059
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: YC14273
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: UD03401
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 05:44:44 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-28 05:44:44 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: XY13260
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13260%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for XY13260: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: SM01273
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM01273%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for SM01273: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: MW24531
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW24531%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for MW24531: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-28 05:44:45 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-28 05:44:45 [auto1.de] INFO: Found listing with ID: XC03196
2026-03-28 05:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:46 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: LM23776
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: JX94750
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: HF95044
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF95044%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for HF95044: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-28 05:44:46 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-28 05:44:46 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: HY44820
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY44820%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for HY44820: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: BC55238
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55238%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for BC55238: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: EU79522
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: GB06112
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-28 05:44:47 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-28 05:44:47 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 05:44:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:48 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: DD75704
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: GD94129
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD94129%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for GD94129: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: LB24374
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: JV29495
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: KJ31397
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: MJ97725
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: NB03512
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: YN70037
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN70037%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for YN70037: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: ED74912
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74912%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for ED74912: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-28 05:44:48 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-28 05:44:48 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-28 05:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:49 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: RV27328
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27328%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for RV27328: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HB28048
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB28048%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for HB28048: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: BJ89189
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ89189%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for BJ89189: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: YE63179
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: YJ80540
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HT24109
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24109%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for HT24109: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: AE54071
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE54071%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for AE54071: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: DS73409
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HV05034
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: KT12988
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12988%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for KT12988: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: YG16236
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-28 05:44:49 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-28 05:44:49 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 05:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:50 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: AZ75969
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ75969%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for AZ75969: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: HR56257
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR56257%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for HR56257: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: KA05574
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: VF13288
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF13288%27 HTTP/1.1" 200 None
2026-03-28 05:44:50 [auto1.de] INFO: Scrape type for VF13288: 0
2026-03-28 05:44:50 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 05:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: JU03795
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: RB44487
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB44487%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for RB44487: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: GD38856
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD38856%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for GD38856: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: KR05534
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 05:44:51 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-28 05:44:51 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-28 05:44:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:52 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: TU77981
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: HP73171
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: RR39705
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: RS29820
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: HR99105
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99105%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for HR99105: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: CJ52428
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: CX13035
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13035%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for CX13035: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: FJ74822
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74822%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for FJ74822: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-28 05:44:52 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-28 05:44:52 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-28 05:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:53 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: LG96473
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: CC79816
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC79816%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for CC79816: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: GH24213
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH24213%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for GH24213: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WV66084
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: HC51034
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: YY26065
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY26065%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for YY26065: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: LD89298
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: AX72910
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: VC37010
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: SB06685
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-28 05:44:53 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-28 05:44:53 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-28 05:44:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:54 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:54 [auto1.de] INFO: Found listing with ID: DV41071
2026-03-28 05:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41071%27 HTTP/1.1" 200 None
2026-03-28 05:44:54 [auto1.de] INFO: Scrape type for DV41071: 0
2026-03-28 05:44:54 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 05:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01824%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for NW01824: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: HR15403
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: RA84296
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: VG06126
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG06126%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for VG06126: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: AG71347
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG71347%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for AG71347: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZV51045
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: WM07863
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: RS51050
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS51050%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for RS51050: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 05:44:55 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-28 05:44:55 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-28 05:44:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:56 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: MT04739
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 05:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-28 05:44:56 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: XZ00200
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: GD72081
2026-03-28 05:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD72081%27 HTTP/1.1" 200 None
2026-03-28 05:44:56 [auto1.de] INFO: Scrape type for GD72081: 0
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: NN04046
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 05:44:56 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: BB09441
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB09441%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for BB09441: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: AW92079
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92079%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for AW92079: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: RN79752
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: TG99958
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: WV47854
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV47854%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for WV47854: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: ZJ08773
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08773%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for ZJ08773: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 05:44:57 [auto1.de] INFO: Found listing with ID: HY62666
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62666%27 HTTP/1.1" 200 None
2026-03-28 05:44:57 [auto1.de] INFO: Scrape type for HY62666: 0
2026-03-28 05:44:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:44:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:44:58 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9199 | hits on page: 40
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PD22194
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: CZ31886
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ31886%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for CZ31886: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: CL03195
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03195%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for CL03195: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: TN12094
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN12094%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for TN12094: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PY36433
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY36433%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for PY36433: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: YX04604
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: SR70263
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR70263%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for SR70263: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: WJ48379
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ48379%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for WJ48379: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: NA05625
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05625%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for NA05625: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: LA17342
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA17342%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for LA17342: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: CP64616
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: YV88881
2026-03-28 05:44:58 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:44:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-28 05:44:58 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-28 05:44:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:00 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: XW21261
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: RN83637
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN83637%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for RN83637: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: VX93609
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX93609%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for VX93609: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: CY67531
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: EF86082
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: DX83058
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX83058%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for DX83058: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP14792%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for FP14792: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: ZA30968
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA30968%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for ZA30968: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: RZ98922
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ98922%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for RZ98922: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: ED07597
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: TR63216
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR63216%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for TR63216: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: FA61594
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA61594%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for FA61594: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-28 05:45:00 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: SP08055
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: YM37957
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 05:45:00 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 05:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:01 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: VX80361
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX80361%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for VX80361: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: VF52184
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZC13523
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZD82611
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD82611%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for ZD82611: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: BE55257
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: VD13122
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD13122%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for VD13122: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ME79930
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for FK15614: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: XG45401
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG45401%27 HTTP/1.1" 200 None
2026-03-28 05:45:01 [auto1.de] INFO: Scrape type for XG45401: 0
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 05:45:01 [auto1.de] INFO: Found listing with ID: EJ14046
2026-03-28 05:45:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:02 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for PV53792: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-28 05:45:02 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 05:45:02 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: JB06991
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB06991%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for JB06991: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: NN29635
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: SU34642
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU34642%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for SU34642: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: GZ05428
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: CJ40917
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ40917%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for CJ40917: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: JA99726
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: GJ23792
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: SJ81609
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ81609%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for SJ81609: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: WJ23528
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-28 05:45:03 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: XE45895
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: BN88120
2026-03-28 05:45:03 [auto1.de] INFO: Found listing with ID: YT80911
2026-03-28 05:45:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:04 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: RP62848
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: JJ98035
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ98035%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for JJ98035: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: LN28697
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN28697%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for LN28697: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: JY30766
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30766%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for JY30766: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: RF64064
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF64064%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for RF64064: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: EY31921
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: GG87690
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG87690%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for GG87690: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: FA75858
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: WN52333
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN52333%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for WN52333: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: PA40823
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA40823%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for PA40823: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: AA44397
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA44397%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for AA44397: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: HU51237
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU51237%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for HU51237: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-28 05:45:04 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-28 05:45:04 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-28 05:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:05 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: EM52017
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM52017%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for EM52017: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: UD22753
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: UE75515
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: YF40819
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: LD62620
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD62620%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for LD62620: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: US02257
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02257%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for US02257: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-28 05:45:05 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 05:45:05 [auto1.de] INFO: Found listing with ID: XJ90591
2026-03-28 05:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ90591%27 HTTP/1.1" 200 None
2026-03-28 05:45:06 [auto1.de] INFO: Scrape type for XJ90591: 0
2026-03-28 05:45:06 [auto1.de] INFO: Found listing with ID: FR11509
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR11509%27 HTTP/1.1" 200 None
2026-03-28 05:45:06 [auto1.de] INFO: Scrape type for FR11509: 0
2026-03-28 05:45:06 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-28 05:45:06 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-28 05:45:06 [auto1.de] INFO: Found listing with ID: PE84798
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE84798%27 HTTP/1.1" 200 None
2026-03-28 05:45:06 [auto1.de] INFO: Scrape type for PE84798: 0
2026-03-28 05:45:06 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 05:45:06 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-28 05:45:06 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-28 05:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:06 [scrapy.extensions.logstats] INFO: Crawled 206 pages (at 38 pages/min), scraped 670 items (at 1 items/min)
2026-03-28 05:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:07 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: DS16746
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS16746%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for DS16746: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: RY43814
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: ER23285
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: NA61105
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: WM57318
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: CJ16536
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: FW84422
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84422%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for FW84422: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: MX67239
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: AM76407
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM76407%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for AM76407: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: XR91127
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: AL22158
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: WK68156
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK68156%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for WK68156: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: FW15775
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15775%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for FW15775: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: YY67246
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: RM23787
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM23787%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for RM23787: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: NP91596
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP91596%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for NP91596: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: GZ90473
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ90473%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for GZ90473: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: JA36918
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: UD76012
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: CE30304
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE30304%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for CE30304: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: PD48755
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD48755%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for PD48755: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: DF55322
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-28 05:45:07 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-28 05:45:07 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-28 05:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:08 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: BJ39418
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ39418%27 HTTP/1.1" 200 None
2026-03-28 05:45:08 [auto1.de] INFO: Scrape type for BJ39418: 0
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-28 05:45:08 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-28 05:45:08 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-28 05:45:08 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: RB15506
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: ZR64045
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR64045%27 HTTP/1.1" 200 None
2026-03-28 05:45:08 [auto1.de] INFO: Scrape type for ZR64045: 0
2026-03-28 05:45:08 [auto1.de] INFO: Found listing with ID: TZ06235
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: WS17164
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: EU47039
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: CM43625
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM43625%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for CM43625: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: PY18559
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY18559%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for PY18559: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: MN13665
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: UJ44809
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ44809%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for UJ44809: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: ZC16188
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC16188%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for ZC16188: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK97361%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for SK97361: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: TT34866
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: HS97116
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS97116%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for HS97116: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: MW11829
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: SZ87491
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: HN55751
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: VY03646
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY03646%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for VY03646: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: WY86449
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY86449%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for WY86449: 0
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: WL89525
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 05:45:09 [auto1.de] INFO: Found listing with ID: XS52651
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS52651%27 HTTP/1.1" 200 None
2026-03-28 05:45:09 [auto1.de] INFO: Scrape type for XS52651: 0
2026-03-28 05:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:10 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: SZ51903
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ51903%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for SZ51903: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FL69651
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL69651%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for FL69651: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: ZX86337
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FP03650
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: LF60633
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: VZ02444
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FH65509
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: CU18716
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU18716%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for CU18716: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: WJ85082
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ85082%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for WJ85082: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: TF47894
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF47894%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for TF47894: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: MX28919
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX28919%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for MX28919: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: XF17082
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17082%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for XF17082: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: VZ57974
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: CU58211
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: CT99178
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT99178%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for CT99178: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: BU19474
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU19474%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for BU19474: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: LX20834
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: RS53381
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: FR48233
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: VC03178
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: AT04961
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT04961%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for AT04961: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: DP93170
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: MK25304
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK25304%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for MK25304: 0
2026-03-28 05:45:10 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-28 05:45:10 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-28 05:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:12 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: PV23410
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: YT49063
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: FE23921
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: RR91619
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: HM21196
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM21196%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for HM21196: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: NK67778
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: TV50499
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: RT04341
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: LK78383
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: RH95863
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: DT99526
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT99526%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for DT99526: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: TL32343
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: NK05730
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: NY96837
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: CW06535
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: SZ37158
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: ZE95100
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE95100%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for ZE95100: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: XK27021
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK27021%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for XK27021: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: NK77096
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: JL68232
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: WN51160
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN51160%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for WN51160: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: ED55965
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: EB27045
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: MB48491
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: JR79236
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79236%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for JR79236: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: XH89248
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: XM39698
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: YP47874
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP47874%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for YP47874: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: AU99982
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99982%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for AU99982: 0
2026-03-28 05:45:12 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-28 05:45:12 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-28 05:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:16 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: CM78199
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78199%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for CM78199: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: XE06638
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE06638%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for XE06638: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: XC20184
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: TW13952
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW13952%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for TW13952: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: SW03797
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: MG59834
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG59834%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for MG59834: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: LU31167
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: EK22988
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: DA26658
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: LN54232
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: UL22027
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL22027%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for UL22027: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: GA30636
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: JZ10962
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ10962%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for JZ10962: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: NF93204
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF93204%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for NF93204: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: KK91293
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91293%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for KK91293: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV45473%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for CV45473: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: RD20926
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD20926%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for RD20926: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: BE69284
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE69284%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for BE69284: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: VE40725
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: KM24929
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM24929%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for KM24929: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: FS97701
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: DF26207
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF26207%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for DF26207: 0
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: GA77173
2026-03-28 05:45:16 [auto1.de] INFO: Found listing with ID: YZ37730
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ37730%27 HTTP/1.1" 200 None
2026-03-28 05:45:16 [auto1.de] INFO: Scrape type for YZ37730: 0
2026-03-28 05:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:17 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: XX78597
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: LN26103
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26103%27 HTTP/1.1" 200 None
2026-03-28 05:45:17 [auto1.de] INFO: Scrape type for LN26103: 0
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: AN38948
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN38948%27 HTTP/1.1" 200 None
2026-03-28 05:45:17 [auto1.de] INFO: Scrape type for AN38948: 0
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: KZ05570
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05570%27 HTTP/1.1" 200 None
2026-03-28 05:45:17 [auto1.de] INFO: Scrape type for KZ05570: 0
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: YV73538
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: LW15406
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW15406%27 HTTP/1.1" 200 None
2026-03-28 05:45:17 [auto1.de] INFO: Scrape type for LW15406: 0
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: KU78731
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU78731%27 HTTP/1.1" 200 None
2026-03-28 05:45:17 [auto1.de] INFO: Scrape type for KU78731: 0
2026-03-28 05:45:17 [auto1.de] INFO: Found listing with ID: PN43025
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN43025%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for PN43025: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: TW48699
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW48699%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for TW48699: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: HX62620
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX62620%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for HX62620: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: PD71224
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: DN90416
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90416%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for DN90416: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: GG89436
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89436%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for GG89436: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: SJ33830
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: NE75834
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE75834%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for NE75834: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: RL39827
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: AB28223
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB28223%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for AB28223: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: CN50169
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN50169%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for CN50169: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: HH76288
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: US13530
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-28 05:45:18 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-28 05:45:18 [auto1.de] INFO: Found listing with ID: GX42293
2026-03-28 05:45:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:19 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YY09343
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: ML17835
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: GW12084
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW12084%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for GW12084: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CL86241
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL86241%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for CL86241: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: UR07800
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: KD93496
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: AL86714
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-28 05:45:19 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-28 05:45:19 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 05:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:20 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for CX20587: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: SJ16961
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ16961%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for SJ16961: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: VV03137
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: ZS51994
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NP21854
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP21854%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for NP21854: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NT84064
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT84064%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for NT84064: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NB66943
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: NK75745
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75745%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for NK75745: 0
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: XT22823
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: AX94045
2026-03-28 05:45:20 [auto1.de] INFO: Found listing with ID: DZ46281
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ46281%27 HTTP/1.1" 200 None
2026-03-28 05:45:20 [auto1.de] INFO: Scrape type for DZ46281: 0
2026-03-28 05:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:21 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: XF90946
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: NJ92771
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-28 05:45:21 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-28 05:45:21 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-28 05:45:21 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-28 05:45:21 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-28 05:45:21 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 05:45:21 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: AE68342
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: AX67376
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: VW08133
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW08133%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for VW08133: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-28 05:45:22 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: LC14083
2026-03-28 05:45:22 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-28 05:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:23 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: FN69423
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW22041%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for XW22041: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: EF60692
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60692%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for EF60692: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: DR21754
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR21754%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for DR21754: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: YL43717
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL43717%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for YL43717: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: FH11160
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: ZM43235
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM43235%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for ZM43235: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-28 05:45:23 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-28 05:45:23 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: FP53719
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: EX24606
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX24606%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for EX24606: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: AE65824
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE65824%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for AE65824: 0
2026-03-28 05:45:24 [auto1.de] INFO: Found listing with ID: GE88369
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE88369%27 HTTP/1.1" 200 None
2026-03-28 05:45:24 [auto1.de] INFO: Scrape type for GE88369: 0
2026-03-28 05:45:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:25 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG88062%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for TG88062: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: XG19073
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG19073%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for XG19073: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY90710%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for BY90710: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84804%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for KV84804: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for CR70146: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for JM16548: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for KL79607: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ21746%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for VZ21746: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for DC30039: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81409%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for TR81409: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-28 05:45:25 [auto1.de] INFO: Scrape type for GC04938: 0
2026-03-28 05:45:25 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-28 05:45:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:26 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for FV94610: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for SM54936: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for EA80690: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for NG80154: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52233%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for BX52233: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for VH10355: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV13508%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for SV13508: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for UP84428: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for BN83173: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for CS48399: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88505%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for VM88505: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA39027%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for LA39027: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for DZ70756: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for TG96584: 0
2026-03-28 05:45:26 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY59799%27 HTTP/1.1" 200 None
2026-03-28 05:45:26 [auto1.de] INFO: Scrape type for KY59799: 0
2026-03-28 05:45:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:27 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-28 05:45:27 [auto1.de] INFO: Scrape type for NG10221: 0
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK36179%27 HTTP/1.1" 200 None
2026-03-28 05:45:27 [auto1.de] INFO: Scrape type for HK36179: 0
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-28 05:45:27 [auto1.de] INFO: Scrape type for HV45616: 0
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-28 05:45:27 [auto1.de] INFO: Scrape type for XT42199: 0
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-28 05:45:27 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 05:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for AW78451: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for SV60739: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for SZ69357: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for YU03537: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for NB27251: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for YP91741: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for LS95970: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for ML63417: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for HK63697: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for ZB26924: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for AN46464: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM96597%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for RM96597: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for LN38152: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for ZE90376: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for TS36559: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for EU51889: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-28 05:45:28 [auto1.de] INFO: Scrape type for AU97195: 0
2026-03-28 05:45:28 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-28 05:45:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:29 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for FZ16195: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for BP38143: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for BT35414: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY27711%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for BY27711: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for NE15652: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for UZ82929: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for LH67751: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for EC33750: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for TS01373: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for FX17488: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for JG50197: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24001%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for CD24001: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for JJ72083: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for GB33155: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69790%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for FR69790: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: ZA85073
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA85073%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for ZA85073: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for SM20101: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for BR69139: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for JW75116: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for PH87632: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ40542%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for BZ40542: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for GC84828: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for UB26055: 0
2026-03-28 05:45:29 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-28 05:45:29 [auto1.de] INFO: Scrape type for LG85121: 0
2026-03-28 05:45:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:30 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:30 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 05:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for CR88792: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF57736%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for RF57736: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG24592%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for RG24592: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for BE15343: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for CK62580: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for ZP86837: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for BD42318: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for WR03810: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for PR23937: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN28352%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for WN28352: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for JD23896: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for WZ14073: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for JB03726: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for GJ05712: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for KK06519: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for KT29520: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-28 05:45:31 [auto1.de] INFO: Scrape type for AB35938: 0
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 05:45:31 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-28 05:45:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:32 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP70991%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for RP70991: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for TX63688: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for HY59950: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for HY06483: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for HR97485: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB84550%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for BB84550: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-28 05:45:32 [auto1.de] INFO: Scrape type for BJ13428: 0
2026-03-28 05:45:32 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 05:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for MY92722: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for ME89657: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC71941%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for ZC71941: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for RC49554: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for XG24427: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for YG21382: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for DY27021: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for RA54991: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL18465%27 HTTP/1.1" 200 None
2026-03-28 05:45:33 [auto1.de] INFO: Scrape type for GL18465: 0
2026-03-28 05:45:33 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 05:45:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:34 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for PB35846: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for LM85601: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for RM51665: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44697%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for DA44697: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for NL59666: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for MN72943: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for RE53759: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for ZW99084: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for RK12981: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for SM28331: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for PP43066: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for DJ93554: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for CZ73559: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for SP41921: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for KP48554: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15127%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for VX15127: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for XN16480: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for ZE79625: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE80885%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for DE80885: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-28 05:45:34 [auto1.de] INFO: Scrape type for JX17185: 0
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 05:45:34 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-28 05:45:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:36 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS57001%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for XS57001: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for SW83321: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for MC36419: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for FZ80305: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for VZ15565: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for PU37095: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for LF81800: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for BP33481: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for YY13521: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for RU59623: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for JK60563: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for ZU18943: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for FS32666: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN32695%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for ZN32695: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-28 05:45:36 [auto1.de] INFO: Scrape type for MR34714: 0
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 05:45:36 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-28 05:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK03700%27 HTTP/1.1" 200 None
2026-03-28 05:45:37 [auto1.de] INFO: Scrape type for MK03700: 0
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-28 05:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK77468%27 HTTP/1.1" 200 None
2026-03-28 05:45:37 [auto1.de] INFO: Scrape type for FK77468: 0
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 05:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-28 05:45:37 [auto1.de] INFO: Scrape type for LW18163: 0
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-28 05:45:37 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-28 05:45:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:38 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for BD50097: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for HM57840: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB90112%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for FB90112: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW30909%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for JW30909: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for VV46432: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for KS78216: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for RC79950: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for UL59525: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC15853%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for AC15853: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for SP19687: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU27790%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for LU27790: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for RG76834: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for UC42370: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for BN55276: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ87943%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for SJ87943: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for EA40469: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA93398%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for MA93398: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX89120%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for TX89120: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for YS81106: 0
2026-03-28 05:45:38 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-28 05:45:38 [auto1.de] INFO: Scrape type for AK08323: 0
2026-03-28 05:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:39 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for XY47977: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS35101%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for PS35101: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for NC46979: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for SB81454: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for GE16553: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for ZR01639: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for ZP29614: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for XU86679: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for EX22671: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for UH40808: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for ZE17013: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for KE92828: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR67018%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for BR67018: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA75512%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for EA75512: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for SU14525: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-28 05:45:39 [auto1.de] INFO: Scrape type for XH92207: 0
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 05:45:39 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 05:45:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:40 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for BD51611: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for TT34897: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK65604%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for BK65604: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP70088%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for EP70088: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for XH60803: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for KH96137: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-28 05:45:40 [auto1.de] INFO: Scrape type for CJ94642: 0
2026-03-28 05:45:40 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 05:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for SD45668: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for FX08537: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for CE85756: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for SF33056: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for BG14243: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for DF93652: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for HV25811: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-28 05:45:41 [auto1.de] INFO: Scrape type for XT97786: 0
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 05:45:41 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 05:45:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:42 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW54336%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for NW54336: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for PS82435: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for HD83134: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for BK83629: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for EL68687: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for ZS15843: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for XE19125: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for DG34410: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for CY33039: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for YJ51408: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for AG88480: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for XU55815: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for PB28144: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for RJ10234: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98886%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for UH98886: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV75211%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for NV75211: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for HX66232: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for CS56497: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for AM15816: 0
2026-03-28 05:45:42 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-28 05:45:42 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-28 05:45:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:43 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU74172%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for JU74172: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for MZ82429: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for GA31373: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for YH04834: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for FL12267: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for WN12652: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for DW51780: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-28 05:45:43 [auto1.de] INFO: Scrape type for TL66452: 0
2026-03-28 05:45:43 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for FY30353: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for DE77804: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for PZ82865: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for WF80406: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for MV18053: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for JR98479: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for KJ86247: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for YK98725: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for DF96715: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for CU86908: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for RU29030: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-28 05:45:44 [auto1.de] INFO: Scrape type for MD24708: 0
2026-03-28 05:45:44 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 05:45:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:45 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for YF55621: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for ZZ43768: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for SB04104: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for MJ60689: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for RJ71204: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for FN85650: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for VC80296: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for CR52623: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for BK49064: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for ZC13254: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for TE33138: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for SA94096: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for ND38532: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for PU73268: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for GX10720: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT83749%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for DT83749: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-28 05:45:45 [auto1.de] INFO: Scrape type for UH00039: 0
2026-03-28 05:45:45 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 05:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-28 05:45:46 [auto1.de] INFO: Scrape type for SA71883: 0
2026-03-28 05:45:46 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 05:45:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:46 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:46 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 05:45:46 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 05:45:46 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for YP68247: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for AP27918: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for UD88757: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for JC63536: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for CR82363: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for KE42269: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for BA02242: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for AW26352: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for ZP61360: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for YM40569: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for AE71125: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for TL23560: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for DG19497: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for UX48590: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for UJ12211: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for GT07597: 0
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 05:45:47 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-28 05:45:47 [auto1.de] INFO: Scrape type for US02416: 0
2026-03-28 05:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:48 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35791%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for CV35791: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for BF26414: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for BR24647: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for RX49945: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for NK53054: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for JM73266: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for JV63052: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for CZ66164: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for JH37191: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for TJ39363: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for UV04147: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for SC19815: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for KN66940: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-28 05:45:48 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-28 05:45:48 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 05:45:49 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 05:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-28 05:45:49 [auto1.de] INFO: Scrape type for AZ50044: 0
2026-03-28 05:45:49 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 05:45:49 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 05:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-28 05:45:49 [auto1.de] INFO: Scrape type for UH90150: 0
2026-03-28 05:45:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:50 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for XS31792: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for YH72749: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for FK36654: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for KP12697: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for BS83474: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for WC52225: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for XX81034: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for EL79145: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for LK89545: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for JA64656: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for SJ09412: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for DL95499: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for ZY13516: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM43459%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for VM43459: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-28 05:45:50 [auto1.de] INFO: Scrape type for VY28868: 0
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 05:45:50 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 05:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-28 05:45:51 [auto1.de] INFO: Scrape type for FS96919: 0
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 05:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-28 05:45:51 [auto1.de] INFO: Scrape type for MT56584: 0
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 05:45:51 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 05:45:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:52 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for FP92588: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV11819%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for HV11819: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66332%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for NE66332: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for XB16241: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: FU30780
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for MA81482: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for NN62521: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for KH74255: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for KA22944: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for YA26169: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for MX79326: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for XT91998: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-28 05:45:52 [auto1.de] INFO: Scrape type for PL64975: 0
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 05:45:52 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 05:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:53 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for GK82878: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for CG37659: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for GV33356: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for EY45109: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for NH13691: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for PH96915: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for WW12135: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for MZ98399: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for LN73181: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for UY19816: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for EJ97789: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for GU30537: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for LS10539: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for LB66833: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for ZL98433: 0
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 05:45:53 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-28 05:45:53 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-28 05:45:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:54 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for RE17291: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for HL98851: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ61544%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for RZ61544: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for CD36219: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for FG21922: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for BV10728: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for YV93929: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for AJ83009: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for EX93586: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for JU52980: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for JB35967: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for BP45840: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for HB08106: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for EP39271: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-28 05:45:54 [auto1.de] INFO: Scrape type for KU58060: 0
2026-03-28 05:45:54 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 05:45:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:56 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for WV16405: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for VE65204: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for VJ38627: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for YE66083: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for YD55328: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for DF45808: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for SA68147: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for DK64287: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for WD52714: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for DY67323: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for NF75522: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for EJ83325: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for GA28860: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for JL37437: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for DG62846: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for NB80689: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for VV98645: 0
2026-03-28 05:45:56 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-28 05:45:56 [auto1.de] INFO: Scrape type for NN79660: 0
2026-03-28 05:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:57 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for JV89856: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for KG22409: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for PL79897: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for YX31470: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for PC35903: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for GD48947: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for WZ21973: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for PR56411: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for KC98509: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for SD64601: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for PA30689: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for WE87101: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for JB08013: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for SR18060: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for CK11382: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-28 05:45:57 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-28 05:45:57 [auto1.de] INFO: Scrape type for MK04993: 0
2026-03-28 05:45:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:45:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:45:59 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9199 | hits on page: 40
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for XP57282: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for LM29335: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for AW80803: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for SK86846: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for TD26953: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for DW78199: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for CV81199: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for UC14298: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for AZ37362: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for LG36185: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for BH48904: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for KF96570: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for FG75722: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for AA34634: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for JE48122: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for VN50855: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for KE73798: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for XH41107: 0
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 05:45:59 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-28 05:45:59 [auto1.de] INFO: Scrape type for VJ90236: 0
2026-03-28 05:45:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:00 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for TS61714: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for WZ35506: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for KU38253: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for DR94699: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for GG98787: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for GE96921: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for BJ86438: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for CH51511: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR21109%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for TR21109: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for WK71622: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for ED74506: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for AG53647: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for RZ52630: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for GY78752: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-28 05:46:00 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 05:46:00 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 05:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:01 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-28 05:46:01 [auto1.de] INFO: Scrape type for WW95477: 0
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-28 05:46:01 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-28 05:46:01 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-28 05:46:01 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-28 05:46:01 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 05:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for FM97642: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for UH05961: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for GA86041: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for SU94182: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for GX08405: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for UD17279: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for PC86421: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for PT78073: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for DT94754: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for MG70959: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for AU40553: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for KZ08446: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for VE16712: 0
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 05:46:02 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-28 05:46:02 [auto1.de] INFO: Scrape type for VZ83010: 0
2026-03-28 05:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:03 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-28 05:46:03 [auto1.de] INFO: Scrape type for VG18386: 0
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-28 05:46:03 [auto1.de] INFO: Scrape type for XV53612: 0
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-28 05:46:03 [auto1.de] INFO: Scrape type for BC20634: 0
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-28 05:46:03 [auto1.de] INFO: Scrape type for HY33546: 0
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 05:46:03 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 05:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for MM42204: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for MK56575: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for XC92552: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for WT06361: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for BU63404: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for AR51863: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for PR96123: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for GE71981: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for ZH23061: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for TW39351: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for VK44645: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for AE67956: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for KD49468: 0
2026-03-28 05:46:04 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-28 05:46:04 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-28 05:46:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:05 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for PH00058: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for VU47138: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for XV26734: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE37736%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for PE37736: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for JN95479: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for FZ44442: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for KZ05104: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for MJ96775: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for SP67485: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for BA65327: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for XV50981: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for JK50656: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-28 05:46:05 [auto1.de] INFO: Scrape type for ZL89473: 0
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 05:46:05 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 05:46:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:06 [scrapy.extensions.logstats] INFO: Crawled 243 pages (at 37 pages/min), scraped 670 items (at 0 items/min)
2026-03-28 05:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 180MiB
2026-03-28 05:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:06 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for GK55952: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for LS92843: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for HC91159: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for YZ54178: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for NZ01572: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for BP97465: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for DZ26190: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-28 05:46:06 [auto1.de] INFO: Scrape type for ZV61779: 0
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 05:46:06 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 05:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-28 05:46:07 [auto1.de] INFO: Scrape type for FY57679: 0
2026-03-28 05:46:07 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 05:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:08 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for JY20975: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for AZ42176: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for XJ52823: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for LN23623: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for TY20606: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for GD49252: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for XP82440: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for JE71066: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for UV35373: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-28 05:46:08 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-28 05:46:08 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 05:46:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:09 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for ZV21910: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for GG36618: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for EZ36931: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for JC98855: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for NN41224: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for BL07705: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25699%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for WL25699: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for SY47772: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for HY54532: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for YJ30839: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for JZ53783: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for JH35819: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for WA46177: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for BC03765: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-28 05:46:09 [auto1.de] INFO: Scrape type for HN35762: 0
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 05:46:09 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 05:46:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:10 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for HY74574: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for DJ60943: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for YY92615: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for LT34656: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for RX21744: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for WC14239: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for MP24640: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for KV52621: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for SR15436: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for FG98454: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-28 05:46:10 [auto1.de] INFO: Scrape type for LZ51858: 0
2026-03-28 05:46:10 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 05:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-28 05:46:11 [auto1.de] INFO: Scrape type for EE83336: 0
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-28 05:46:11 [auto1.de] INFO: Scrape type for MK68330: 0
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-28 05:46:11 [auto1.de] INFO: Scrape type for EN87643: 0
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-28 05:46:11 [auto1.de] INFO: Scrape type for DL95738: 0
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-28 05:46:11 [auto1.de] INFO: Scrape type for EE47026: 0
2026-03-28 05:46:11 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 05:46:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:12 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for GE21325: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for FH64312: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for PU00921: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for CB80286: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for DP87789: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for XS07294: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ72723%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for ZZ72723: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for MR65343: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG62557%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for TG62557: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for DG34308: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for XR37106: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for GW52920: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for AJ13004: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for UT93934: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for DJ80434: 0
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 05:46:12 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-28 05:46:12 [auto1.de] INFO: Scrape type for UJ55086: 0
2026-03-28 05:46:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:13 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for FH45720: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for FA96638: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for MX66491: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for JV68298: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for JY05464: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for BZ75769: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for BN23533: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for KL73476: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for UF45337: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: PK01210
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for DB09685: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for DA75557: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for RH12349: 0
2026-03-28 05:46:13 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-28 05:46:13 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for EW68189: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for NA20314: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for JV29717: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for DG61616: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for YU15721: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for TX40728: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for UG67799: 0
2026-03-28 05:46:14 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-28 05:46:14 [auto1.de] INFO: Scrape type for SJ84971: 0
2026-03-28 05:46:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:15 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for HA98136: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for KG20268: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for RF75953: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for DD09602: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for YV35353: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for XJ97474: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for DG85302: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for XY91338: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for PZ33404: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for LL15014: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-28 05:46:15 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 05:46:15 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 05:46:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:17 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for XU56450: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for BC73225: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for WA42896: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for EG39576: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for WP15063: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for UE87725: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for BD92511: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for VC64340: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for BB57132: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for AV32823: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for AR39544: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for UC84662: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for TE93454: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for ZR21062: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for KY14800: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for UK28152: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for RV94916: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-28 05:46:17 [auto1.de] INFO: Scrape type for UZ90215: 0
2026-03-28 05:46:17 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 05:46:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:18 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for CZ08846: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for RW84791: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47665%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for EJ47665: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for DM49539: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for UH91436: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for WE65713: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for ZY93547: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for YH44643: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for FS06029: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for UB65858: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for TH26087: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for BM76815: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for WU91677: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for WF94997: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for ZY07029: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72039%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for ZN72039: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for BU23510: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for JP08522: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-28 05:46:18 [auto1.de] INFO: Scrape type for ZN44804: 0
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 05:46:18 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 05:46:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:20 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for SB93381: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for JV68869: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for FS76993: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for KY06770: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for VW42745: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for CD81555: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for SW77788: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for JN93492: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for KG12536: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for VE70317: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for UH14154: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for TE25882: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for JL71783: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-28 05:46:20 [auto1.de] INFO: Scrape type for UG93766: 0
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 05:46:20 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 05:46:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:21 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for ZG28999: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for RD48040: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for JH55559: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91150%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for RY91150: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for DV93424: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for UA99950: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for GN10929: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for VH64157: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for GA31653: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for NP49973: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for GR11096: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for CP54704: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for JU59461: 0
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 05:46:21 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-28 05:46:21 [auto1.de] INFO: Scrape type for AH29152: 0
2026-03-28 05:46:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:22 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for YY76457: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for FM08350: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for TB15164: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for JG77097: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for FZ02201: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for CJ75518: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for UM10671: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-28 05:46:22 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-28 05:46:22 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 05:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for NX83651: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for DG35961: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for PE88968: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for BH52991: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for DM95893: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-28 05:46:23 [auto1.de] INFO: Scrape type for XD89320: 0
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 05:46:23 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 05:46:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:24 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for XR69964: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for CA38480: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for AR19685: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for PK38056: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK51592%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for KK51592: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for RC78323: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for VB96558: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for XC54847: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for DF63833: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for YJ19270: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for MS86460: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for ZU48886: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for NU47228: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30878%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for YW30878: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for KV22200: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for MS46414: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for LT68556: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-28 05:46:24 [auto1.de] INFO: Scrape type for KF96010: 0
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 05:46:24 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 05:46:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:25 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 05:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-28 05:46:25 [auto1.de] INFO: Scrape type for PW65541: 0
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 05:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-28 05:46:25 [auto1.de] INFO: Scrape type for JU04620: 0
2026-03-28 05:46:25 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for TE97467: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE61200%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for CE61200: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for AE19293: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for PS95073: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for FV21429: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for ZZ71304: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for ZR48762: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for MM29891: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for AX34994: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ17668%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for PZ17668: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for SK36887: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for SX14499: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF65370%27 HTTP/1.1" 200 None
2026-03-28 05:46:26 [auto1.de] INFO: Scrape type for EF65370: 0
2026-03-28 05:46:26 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 05:46:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:27 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-28 05:46:27 [auto1.de] INFO: Scrape type for MH69826: 0
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-28 05:46:27 [auto1.de] INFO: Scrape type for ER51805: 0
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-28 05:46:27 [auto1.de] INFO: Scrape type for TW44182: 0
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-28 05:46:27 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-28 05:46:27 [auto1.de] INFO: Scrape type for UK53846: 0
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 05:46:27 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for FB84476: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for KM30220: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for YS55163: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU02017%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for XU02017: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for PV05136: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN45636%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for RN45636: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for XG58500: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for AE20511: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for EM07898: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK76499%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for ZK76499: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for NB76223: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for VD78060: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-28 05:46:28 [auto1.de] INFO: Scrape type for AH76263: 0
2026-03-28 05:46:28 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 05:46:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:29 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for JZ27200: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN31316%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for MN31316: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for MV29238: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ67378%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for ZZ67378: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for DP29257: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for AB91647: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for DE97424: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for VU87810: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for YT23493: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for SG45396: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for MV46979: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for ZV10923: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for ZY72717: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for CY44920: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for DV32986: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-28 05:46:29 [auto1.de] INFO: Scrape type for CB12842: 0
2026-03-28 05:46:29 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 05:46:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:30 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74086%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for UZ74086: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for UT27249: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML66978%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for ML66978: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75930%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for CJ75930: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW49468%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for XW49468: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for PC62397: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32750%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for MX32750: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for RA07752: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF06816%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for WF06816: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66825%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for XV66825: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for JW24568: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT88012%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for RT88012: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU73133%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for EU73133: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for AN15165: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-28 05:46:30 [auto1.de] INFO: Scrape type for YK99785: 0
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 05:46:30 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-28 05:46:31 [auto1.de] INFO: Scrape type for EG76856: 0
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-28 05:46:31 [auto1.de] INFO: Scrape type for FU68975: 0
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-28 05:46:31 [auto1.de] INFO: Scrape type for VN54723: 0
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-28 05:46:31 [auto1.de] INFO: Scrape type for RC64301: 0
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-28 05:46:31 [auto1.de] INFO: Scrape type for TB14981: 0
2026-03-28 05:46:31 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 05:46:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:32 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for PA20304: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for VJ29661: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for SX40224: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS17240%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for XS17240: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for EK35927: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for NV35825: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for GB27132: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for SR34905: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for BN62296: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for AJ78717: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for GN45872: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35673%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for NS35673: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for BP24575: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for JA25299: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for VH71903: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02806%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for GD02806: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for YV03143: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR56671%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for UR56671: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for GY83216: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for DB09023: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for GA20411: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-28 05:46:32 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-28 05:46:32 [auto1.de] INFO: Scrape type for BP39068: 0
2026-03-28 05:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:33 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for XS67256: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for CS24568: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for YS72291: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for NU40384: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for SU61840: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for FD22353: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for WZ92700: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for XY63966: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for FZ45055: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for AR79819: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for EL90308: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for GV00084: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for MH67551: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for HN51683: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for VT53198: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for XX92411: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for NY45710: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for GV20028: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-28 05:46:33 [auto1.de] INFO: Scrape type for ZV16812: 0
2026-03-28 05:46:33 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 05:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-28 05:46:34 [auto1.de] INFO: Scrape type for CF89653: 0
2026-03-28 05:46:34 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 05:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-28 05:46:34 [auto1.de] INFO: Scrape type for HD43211: 0
2026-03-28 05:46:34 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 05:46:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:35 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9199 | hits on page: 40
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for WX24181: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for VE61397: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for GJ83963: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for ZT05209: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for SY84491: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-28 05:46:35 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-28 05:46:35 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 05:46:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:36 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9199 | hits on page: 39
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47280%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for PV47280: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY61545%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for UY61545: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ15198%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for PZ15198: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43081%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for CS43081: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK35465%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for VK35465: 0
2026-03-28 05:46:36 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB83488%27 HTTP/1.1" 200 None
2026-03-28 05:46:36 [auto1.de] INFO: Scrape type for XB83488: 2
2026-03-28 05:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with identifier: XB83488
2026-03-28 05:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with scrape type 2
2026-03-28 05:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with scrape type 2
2026-03-28 05:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec, identifier: XB83488
2026-03-28 05:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with identifier: XB83488
2026-03-28 05:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with identifier: XB83488
2026-03-28 05:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec with identifier: XB83488 to the API
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:03:47Z',
 'fuel_type': 'petrol',
 'id': '96c1df1e-ca8e-56b5-b9e9-f9c1b31558ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB83488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 5',
 'odometer': 166465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-24',
 'seller_name': None,
 'title': 'Audi RS 5 4.2 V8 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB83488%27 HTTP/1.1" 200 None
2026-03-28 05:46:37 [auto1.de] INFO: Saving data for XB83488: {'auction_closing_time': 1774713827.0, 'created_time': 1774035020.738517, 'last_price_update_time': 1774676797.618043}
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB83488') HTTP/1.1" 204 0
2026-03-28 05:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:46:37 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-28 05:46:37 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-28 05:46:37 [auto1.de] INFO: Scrape type for GX91022: 2
2026-03-28 05:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-28 05:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with scrape type 2
2026-03-28 05:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with scrape type 2
2026-03-28 05:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1, identifier: GX91022
2026-03-28 05:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-28 05:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-28 05:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022 to the API
2026-03-28 05:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'petrol',
 'id': '4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX91022',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 31647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-28 05:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-28 05:46:38 [auto1.de] INFO: Saving data for GX91022: {'auction_closing_time': 1774716060.0, 'created_time': 1774118698.283587, 'last_price_update_time': 1774676798.123571}
2026-03-28 05:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX91022') HTTP/1.1" 204 0
2026-03-28 05:46:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:46:38 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9199 | hits on page: 0
2026-03-28 05:46:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 05:46:38 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-28 05:46:38 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 1, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-28 05:46:39 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (672 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-28T05_35_00.jl
2026-03-28 05:46:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 811432,
 'downloader/request_count': 305,
 'downloader/request_method_count/GET': 72,
 'downloader/request_method_count/POST': 233,
 'downloader/response_bytes': 82348067,
 'downloader/response_count': 305,
 'downloader/response_status_count/200': 305,
 'dupefilter/filtered': 10,
 'elapsed_time_seconds': 692.444992,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 5, 46, 38, 919970, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 672,
 'log_count/DEBUG': 15021,
 'log_count/INFO': 19931,
 'memusage/max': 189530112,
 'memusage/startup': 147759104,
 'photo_download_count': 40,
 'request_depth_max': 234,
 'response_received_count': 265,
 'scheduler/dequeued': 305,
 'scheduler/dequeued/memory': 305,
 'scheduler/enqueued': 305,
 'scheduler/enqueued/memory': 305,
 'scrape_type/batch_skipped': 4613,
 'scrape_type/new': 15,
 'scrape_type/price_update': 657,
 'scrape_type/skipped': 3944,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 265,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.323165775294291,
 'scrapy-zyte-api/mean_response_seconds': 2.4453153164389563,
 'scrapy-zyte-api/processed': 265,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 265,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 264,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 265,
 'scrapy-zyte-api/request_args/httpRequestBody': 233,
 'scrapy-zyte-api/request_args/httpRequestMethod': 233,
 'scrapy-zyte-api/request_args/httpResponseBody': 265,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 265,
 'scrapy-zyte-api/request_args/sessionContext': 265,
 'scrapy-zyte-api/request_args/url': 265,
 'scrapy-zyte-api/status_codes/200': 265,
 'scrapy-zyte-api/success': 265,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 9239,
 'source/total_available': 9199,
 'start_time': datetime.datetime(2026, 3, 28, 5, 35, 6, 474978, tzinfo=datetime.timezone.utc)}
2026-03-28 05:46:39 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 05:46:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f22e0fc6050>
2026-03-28 05:46:39 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f22e0fc6450>